SUMMARY 



Background 

Memi^is State University is a growing state institution located 
in the center of the rapidly changing Mid-South area* Since its be- 
ginning as a normal school, the university has offered leadership in 
education to West Tennessee, Eastern Arkansas, and Northern Mississippi* 
Because of the newly emerging industrial culture, and the resulting 
social revolution, the present educational problems in the Mid-South 
are unique to the area and present crucial educational personnel needs* 

In 1966-67, the Mid-South Undergraduate Research Training Program 
was established through a grant from the U* S* Office of Education to 
develop personnel capable of and interested in (1) upgrading existing 
educational curricula throu^i research, (2) seeking better educational 
practices through empirical knowledge in the usage of research tedini- 
ques by teadiers to improve classroom instruction, (3) applying researdi 
methods to provide insights into sociological problems related to 
educational practice, and (4) utilizing research and evaluation techni- 
ques to improve and innovate educational practice* The 1967-68 program 
represents an extension of the original program* 



Program Description 

The Mid-South Undergraduate Research Training Program maintained 
the following general objectives: 

1* to identify undergraduate research talent; 

2* to stimulate Interest in and to develop appreciation of 
research and research training; 

3* to foster the study of educational researdi as a field of 
knowledge; 

4* to develop research skills; 

5* to establish a firm basis for a graduate program in research; 

6* to attract and to Involve exceptional students in conducting 
research studies in a field of educational specialization, 
sudi as special education, teacher training, or reading 
instruction* 

The Mid-South Undergraduate Research Training Program depended 
heavily upon a type of faculty attention to individual students and 
training experiences which was not prohihid tithin the structure of the 
traditional classroom* The program dedilbpail dohiisted of four three 
semester hour course titles taught hf 8 IM of f^eireh instructors* 

A reseer :h practicum in which studeuv^ projects wae 

conducted in a seminar* One couifae 4 ih bUe of the follow- 
ing specialty areas: teacher triihihii feddiii iiiitructlon, or special 

education* 
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SUMMARY 



Background 

Memi^is State University is a growing state institution located 
in the center of the rapidly changing Mid-South area. Since its be- 
ginning as a normal school > the university has offered leadership in 
education to West Tennessee, Eastern Arkansas, and Northern Mississippi* 
Because of the newly emerging industrial culture and the resulting 
social revolution, the present educational problems in the Mid-South 
are unique to the area and present crucial educational personnel needs* 

# 

In 1966-67, the Mid-South Undergraduate Research Training Program 
was established through a grant from the U* S* Office of Education to 
develop personnel capable of and interested in (1) upgrading existing 
educational curricula through research, (2) seeking better educational 
practices through empirical knowledge in the usage of research techni- 
ques by teachers to Isqprove classroom instruction, (3) applying researdh 
methods to provide insights into sociological problems related to 
educational practice, and (4) utilizing research and evaluation techni- 
ques to improve and Innovate educational practice* The 1967-68 program 
represents an extension of the original program. 



Program Description 

The Mid-South Undergraduate Research Training Program maintained 
the following general objectives: 

1. to identify undergraduate research talent; 

2* to stimulate interest in and to develop appreciation of 
research and research training; 

3* to foster the study of educational research as a field of 
knowledge; 

4* to develop research skills; 

5* to establish a firm basis for a graduate program in research; 

6* to attract and to Involve exceptional students in conducting 
research studies in a field of educational specialization, 
such as special education, teadier training, or reading 
instruction* 

The Mid-South Undergraduate Research Training Program depended 
heavily upon a type of faculty attention to individual students and 
training experiences which was not |»roliitlii Ititllin the structure of the 
traditional classroom. The prograil devilb^ cdjiiiited of four three 
semester hour course titles taught ^ i hi feSeivch Instructors* 

A resear :.h practicum in which studeui>> hii ^eit projects wae 

conducted in a seminar. One course wS| 4 ih hue of the follow- 
ing specialty areas: teacher trainihii fei4ii|| ihitruetion, or special 

education* 



During the first semester the students were required to attend 
three courses: (1) Education Tests, Measurements, and Practlcum I 

(Education 4511), (2) Introduction to Educational Statistics 1 
(Education 4521), and (3) Educational Statistics XI and Research Design 
(Education 4512). During the second semester the students were en- 
rolled in (1) Education Tests, Measurements and Practlcum II (Educa- 
tion 4522), (2) the required specialty area course for three semester 
hours, and (3) a two-hour weekly seminar on research application. 

Three instructors team-taught the four research courses and coordinated 
the research seminar with the practice teaching requirements of the 
students. 



Program Products 

The acceptance of the Mid-South Undergraduate Research Training 
Program in the Mid-South was manifested by such events as invitations 
to make presentations to practitioners and students. Second, feature 
articles on the program were published in the major local newspaper. 
Finally, the successful continuation of the trainees in research serves 
as a manifestation of Interest in and appreciation of resear<di. 

The 1966-67 program began with fifteen students ^o possessed an 
average grade point of 3.11 on a 4.00 system and who possessed ACT 
scores above the 80th percentile. Of the fifteen students three 
dropped from the program, one to take a full-time testing and counseling 
job, and another to become a researcdi coordinator of a Title I ESEA 
program; five continued their studies at Memphis State University as 
researdi assistants; four are new completing master's degrees at other 
universities; one entered the teaching profession; one became a research 
associate in the Memphis City Schools; and one entered the Insurance 
business. Three of the five students who remained at Memphis State 
University are now entering master's degree programs in research 
training at other universities. 

The 1967-68 program began with ten scholarship students who 
possessed an average grade point of 3.09 on a 4.00 system and three 
other students whose average grade point was 2.65. All thirteen students 
were above the 80th percentile on the ACT. All thirteen students 
completed the program. Two of them are becoming research associates in 
the local school systems; four are planning to teach; and one of the 
students is being drafted. Three will remain at Memphis State University 
to finish their undergraduate degrees and to work as research assistants. 
Two plan to enter master degree programs in research training, and one 
is currently undecided about her future. 



Projections 

The Mid-South Undergraduate Researdi Training Program, in spite 
of the phasing out of the funding by the U.S. Office of Education, will 



be continued at Memphis State University. Part of the costs of the 
program to the University will be defrayed through funds designated 
in the West Tennessee Research Consortium to support ten students. 

The demand of local school systems for graduates of the research 
training program to serve as research associates in evaluation positions 
for federal and local programs has prooqpted this decision. A grant for 
a continuation of this program has been proposed as a component of 
Meii^hls State University's "Delta Flow Project" submitted under Parts 
C and D of the Education Professions Development Act. 



INTRODUCTION 



Setting 

Mesqphis State University has In the past decade moved from a 
state teachers college of 4,000 students to a young, expanding univer- 
sity of over 15^000 students. The growth of the university is 
paralleled by the rapid growth of the city of Memphis and by the 
rapid increase of interest in education in the Hid- South. The Mid- 
South area is undergoing crucial changes created by urbanization, the 
social revolution, and modem technology. 



Needs 



The social, industrial, and educational changes occuring in the 
Mid-South have developed a comparatively virgin setting for research. 

The critical nature of the local educational problems, created by a 
changing society interacting with the unique cultural history of the 
area, has enticed Mid-South educators to look toward educational 
research for assistance. Unfortunately, there is a current shortage 
of research opportunities. The university research talent in the past 
that clashed with the conservative populace formerly migrated to 
settings where research was a rewarded endeavor. 

Educational research activities were extremely limited until 
programs funded by the Elementary and Secondary Education Act, as well 
as other federal programs, offered supplementary financing for programs 
designed to meet local needs. Problems in the assessment of needs, 
program evaluation, and research methodology are critical needs in 
school systems. Until the last three years Memphis State University 
was offering only limited help because of its own shortage of personnel. 
In recent years, the University has made major strides in expanding and 
developing its professional personnel needs. 



Rationale 

Limited funds and programs for researdi and reseeirch training 
created the virtual absence of even research technicians in the 
Mid-South area thus making productive research difficult and too 
limited to be effective. An expanded college curriculum was needed 
giving more attention to courses in tests and measurements, statistics, 
and research methods. Additional research personnel were needed at 
the university to train persoimel to operate as technicians in research 
projects to precede the development of large scale, meaningful research 
projects. 
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When Memphis State University began to enter Into a major 
development of research services In 1965, the decision was made to 
start building at the undergraduate level and continue the develop- 
ment of a complete research training program through the doctorate. 
This program. In a comparatively virgin setting like the Mid-South, 
can accomplish the objective of providing the region with research 
technicians and highly skilled research specialists* While research 
specialists are required, it should also be recognized that personnel 
who complete only segments of the program also provide service to the 
area. They usually remain In the area to provide the technical 
personnel needed to carry on productive research. With the existence 
In the local school systems of skilled and semi-skilled research 
personnel, and with the attraction of doctorates In research to the 
University through the activities of research training programs, the 
necessary team metiers for productive research are now beginning to 
work In the MLd-South area. 



METHODS 



Objectives 

Basically, the Hid--South Dadergraduate program sought to take 
exceptionally talented students, offer them an accelerated Instructional 
program in research fundamentals, and direct them toward further research 
training or place them in research activities in the local area. Hence, 
the program maintained the following general objectives: 

1. to identify undergraduate research talent; 

2. to stimulate Interest in, and to develop an appreciation of, 
research and. research training; 

3. to foster the study of educational research as a discipline; 

4. to develop research skills; 

5. to establish a firm basis for a graduate program of research; 
and 

6. to attract and to involve exceptional students in conducting 
research studies in a field of educational specialisation, 
such as special education, teacher training, or reading 
instruction. 



EligibiUty 

Five criteria were utilized in the selection of scholarship students: 

1. each candidate was to be either a junior or senior undergraduate 
student capable of meeting the entrance requirements of M^phis 
State University (seniors were given preference in recruiting 
and twelve of the thirteen students were classified as seniors): 

2. each candidates was to be enrolled in the full-time pursuit of 
a degree and was to be eligible for admir.tance to the teacher 
education program; 

3. each candidate was to possess either a 3.00 grade point average 
on a 4.00 system or 80 percentile on the ACT test; 

4. each candidate was to express a sincere interest in educational 
research during an interview with the program staff; and 

5. eadi candidate was to demonstrate capeibillty in mathematics. 

Generally, the 1967-68 students were recruited by the 1966-67 students; 
however, there was some response to the printed brochures which were 
distributed. 
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Curriculum 



The nature and history of the area dictate the importance of 
initial and noticeable success in research development, Throu^ the 
selection of exceptional students and through the structuring of the 
program to provide for frequent and individual interaction of facu y 
and trainees, the probability of program success was increased. 



Since there were no previously existing ^ 

structures, heavy practlcum applications were easy to build into the 
curriculum. The program consisted of (1) four specific courses in 
research training of idiich offered three semester hours credit; (Z) 
a general seminar of practicum activities in research; ^ 
additional required course in a selected specialty area (either tcachc 
training, reading instruction, or special education). During the 
first semester the students were required to complete three 
nastely; Educational Tests, Measurements, and Practic^ (Education 45li;, 
Introduction to Educational Statistics I (Education 4521) ; and Educa- 
tional Statistics and Research Design (Education 4512). 



The three first semester courses were team taught in a ^^^ce hour 
block that met three times each week. The courses were designed to 
teach research and testing fundamentals and to establish a 
philosophy based upon hypothesis building and critical thtnlang. TO 
texts for these courses were (1) Foundati o ns of Behavior^ Researd i y 
Kerlinger, (2) Introduction to Educational Statistics, ^ . 

( 3 ) Introduction to Tests and Measurement by Downie. The texts used in 
the development of fundamentals became only part of the - 

library made available to the students through the Bureau of Educational 
Research and Services. Gage’s Handbook of Resear ch in Teaching 
provided a major reference source. 



During the second semester the students were enrolled in Education 
Tests, Measurements (Education 4522); in Practicum II, the raqulred 
specialty area course for three semester hours; and a two-hour weekly 
seminar in research application coordinated with student teochlng 
experiences during which the students in specialty area teams pursued 
team projects coordinated by the seminar. 



Laboratory 

In order to expose the trainees to the real world of education, 
several laboratory experiences were established for them through the 
Bureau of Educational Research and Services. In addition to the 

experiences provided by the Bureau, the J 

involving the Central Midwestern Regional Educational Laboratory, the 

Mid-South Teacher Corps, the West Tennessee Research 
Consortium, the Millington Naval Air Training Station, 

Educational Advisory Board. The students had limited participation in 
a small research contract on "Self-Supervision," in an 
training program in Henry County, and in the development of a Title IXI 
ESEA proposal for a school in the Shelby County school district (Winchester) 









RESULTS 



Research Trainees 

The 1966-67 prograa began with fifteen students who possessed an 
average grade point of 3.11 on a 4.00 system. Each student who had an 
ACT score, scored above the 80th percentile. Of these fifteen students 
two dropped the program to accept full-time employment in research 
activities and one dropped because of the Illness of his wife. Of the 
twelve sthdents who completed the program, five rer lined at the Univer- 
sity as research assistants to con^lete their undergraduate degrees. 

Of the four program graduates who entered graduate study in other 
universities, two gained scholarships and two received assistantshlps. 
Of the reamining trainees, one entered the teaching profession, one 
was hii i'-- as a research associate in the research division of the 
Memphis City School System, and one entered the insurance business. 



Candidate Data 1965-67 



Names 


GPA 

4 pt. system 


ACT 

Composite 


Status 


Selections ; 


1. Truman L. Atkins 


3.08 


95.0 


Senior 


2. Helen P. Best 


2.94 


81.0 


Senior 


3. Virginia W. Blanton 


2.96 


83.0 


Senior 


4. Terry Ann Bond 


2.98 


99.0 


Junior 


5. Phyllis A. Burdette 


3.14 


No record 


Senior 


6. Kathy Marie Eggers 


2.91 


99.0 


Senior 


7. Pallie B. Hamilton 


3.41 


No record 


Senior 


8. Roy A. Hardy 


3.28 


97.0 


Senior 


9. Lawrence N. Koss 


2.99 


84.0 


Junior 


10. Nodya Jean Loftiss 


2.72 


94.0 


Junior 


*11. Shirley McClintock 


3.56 


No record 


Junior 


12. Patricia A. Teague 


3.75 


No record 


Senior 


**13. Dana Thrasher 


3.48 


No record 


Senior 


14. Mary Lou Wallace 


2.82 


80.0 


Senior 


15. Thomas Carl Watson 


3.02 


No record 


Senior 


Alternates : 


***16. Thomas Ray Greer 


3.04 


No record 


Senior 


***17. Patricia Seymore 


2.62 


94.0 


Junior 


*18. Almeda M. Zent 


3.00 


78.0 


Senior 



*Had to drop program because of scheduling problem. 

**Dld not accept program because of unseen school program commitments 
(activity honors). 

***Scholarshlps were transferred to these two alternates. 



The 1967-68 program began with ten scholarship students who possess- 
ed an average grade point of 3.09 on a 4.00 system and three other 
stiidents whose average grade was 2.65. All thirteen students possessed 
a minimum ACT percentile of 80 or above and all completed the program. 

Two of them have been employed as research associates in. local ' school 
systems. Four plan to teach, and one is being drafted. Three will 
remain at Hemphis State University as undergraduate research assistants. 
IVo plan to do graduate study in research training, and one is tmdecided 
about his future. 



Candidate Data 1967-68 



Names 4 


GPA 

pt. system 


ACT 

Composite 


Status 


Selections : 


1. Theresa A. Browning 


3.00 


92.0 


Senior 


2. Lee Elizabeth Carothers 


3.20 


89.0 


Senior 


3. Patricia L. Couch 


3.18 


90.0 


Senior 


4. Mary Jo Dye 


3.83 


95.0 


Senior 


5. Janice Gale Goff 


2.99 


91.0 


Junior 


6. Charles H. Holland, Jr. 


2.76 


84.0 


Senior 


7. Lea W. Joyner 


2.83 


85.0 


Senior 


8. Patricia A. Mahaffey 


3.06 


90.0 


Senior 


9. Charlene H. Mott 


3.04 


86.0 


Senior 


10. Lucy T. Reap 


3.00 


92.0 


Senior 


Other Students: 


11. Louida McCombs 


2.69 


82.0 


Senior 


12. Walter Mathis 


2.62 


80.0 


Senior 


13. Lynn Wells 


2.65 


85.0 


Senior 



Program Progress 

In order to evaluate the program an adjective check list and an 
open-ec<ked questionnaire were given the participants. The results of 
these two data sources with other data sources, such as results of content 
testing, will be reviewed in regard to program objectives. 

The undergraduate research training program was able to identify 
iindergraduate researdi talent. The excellence of grade point averages, 
the number of the trainees remaining in research, and the performance of 
the researdi training students on the materials and tests developed by 
Baker and Sullivan (mean scores were slightly above the mean scores of 
the participants in the AERA workshops in New York, 1967) , substantiate 
that objective one, talent identification, was met. However, there exists 
some disappointment in that scholarships were required to Interest the 
students to enter the program, even though 80 percent of them reported 
that they would have taken the program without a scholarship if they had 
had proper program expectancy. 
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Newspaper articles , program inquiries^ and Increased research 
activity indicate that interest in research was stimulated. The continued 
study of research by program participants offers evidence that an 
appreciation of research was developed. Unfortunately, this Interest 
has failed to generalize to most of the area. Continued efforts can be 
expected to gain the objective of generalized regional interest. 

Students in research training now recognize educational research 
as a legitimate field of knowledge. The continiiation of the program and 
the development of additional graduate coiirsee in educational research 
will substantiate this conclusion and will justify offering an opportunity 
to develop research skills. The undergraduate research training program 
has paved the way for the establishment of excellent field study 
laboratories, stronger graduate courses in research, and competent 
personnel to serve the graduate study of research. 

On the adjective dieck list ten questions were asked. Five bi-polar 
adjectives were assigned to each question with a nine-point continuum 
between eadi. Twelve of the thirteen students responded to the question- 
naire. The bi-pblar adjectives are listed below each question, and the 
response pattern is shown between the adjectives. 



1. The effect of the entire research training progran on 
anticipated classroom teaching: 



GOOD 

USELESS 

POSITIVE 

IMPHACTICAL 

IMPORTANT 




BAD 

VALUABLE 

NEGATIVE 

PRACTICAL 

UNIMPORTANT 



2 . 



Influence of the program on toy future career: 

3 i 0 s 2 t l ; 0 ; l : 0 ; l : 4 
USELESS 0;0 ; 0 : 0:0 t l : l : l ; 9 
POSITIVE 5:3:3 t l : 0!0:0 : 0 : 0 
IMPORTANT 4:2:4 ; 2 : O:O:0 :0 s0 
good 2 ; 3 ; 2 : 0 : o:o :0i 0 v Q__ 



UNCHANGED 

VALUABLE 

NEGATIVE 

IDUMPORTANT 

BAD 
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3. Class organization: time blocks, current pattern of 3 sessions 

first semester y 1 session second semester: 

good 0 : 2 : 2 : 1 : 2 : 1 : 2 : 0 ; 2 BAD 

IMPEAGTICAL 1 : 1 : 2 : 1;3 ; 0 ; 1 : 1 ; 2 PRACTICAL 

CONPENIENT l : l r O : l : 3 ; 2 : 0 : 2 ; 2 INCONVENIENT 

USELESS 0 : 0 : 0 : 1;2 : 4 : 1 : 3 ; 0 VALUABLE 

SATISFYING 1: 2 ; Q : 2 : 3 : 2 : 1 : 1 ; 0 DISAPPOINTING 

4. Class assignments, homework, semester projects: 

4 » 7:0:1 : 0 : 0 ; 0 ; 0 ; 0 
PRACTICAL 6 : 5 : 1 : 0 : 0:Q : 0;0 ; 0 UNPRACTICAL 
USELESS Q : 0 : 0 : 0 : Q : 0 ; 1 ; 5;6 VALUABLE 
SATISFIING 4: 3:l:2 : l : l : 0 : 0 : Q DISAPPOINTING 
IMPORTANT 7 : 3 : 2 : 0 : 0 : 0 ; 0 : 0 ; 0 UNIMPORTANT 

5. Text materials, library guidance, reference materials, 
mimeographed materials, etc. 



BAD 


0 


jJl 


jJl 




-•JL 




; 2 : 


5 : 


5 


GOOD 


USELESS 


0 




-*J9L 






JJL 


; 1 : 


A.*. 


5 


VALUABLE 


PRACTICAL 


3 


: 6 


J-1. 


: 0 


-•JL 


; 0 


: 0 ; 


0 : 


0 


IMPRACTICAL 


SATISFTING 


3 


.:JL 


-*JL 


: 0 


-•JL 


JJL 


; 1 : 


0 : 


0 


DISAPPOINTING 


organized: 


6 




: 0 


: 0 


: 1 


: 0 


: 0 : 


0 : 


0 


DISORGANIZED 


Class structure, 


professional climate, formalitv,. 


personal 


attention to profession-'related problems: 








BAD 


0 


: 0 


: 0 


: 0 


: 0 


: 0 


: 1 : 


2 : 


9 


GOOD 


USELESS 


0 


: 0 


: 0 


: 0 


: 0 


: 0 


: 1 : 


4 : 


7 


VALUABLE 


PASSIVE 


0 


: 0 


: 0 


: 0 


: 1 


: 1 


: 0 : 


3 : 


7 


ACTIVE 


FRIENDLY 


8 


: 2 


: 2 


: 0 


: 0 


: 0 


: 0 : 


0 : 


0 


UNFRIENDLY 


SATISFYING 


6 


: 4 


: 2 


: 0 


: 0 


: 0 


: 0 : 


0 : 


0 


DISAPPOINTING 
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7, Recruitment literature and recruitment activities 



ACCURATE 1 ; 2 : 2 ; 0 ; 0 ; 2 ; 0 ; 1 ; 3 MISLEADING 

STIMULATING 0 ; 1 : 4 ; 1 ; Q : 1 ; 0 ; 2 ; 2 DULL 

UNORGANIZED O ; 0 i O ; Q ; l;2 ; 3 ; 3;2 ORGANIZED 

UNDERSOLD 3 ; 2 ; 1 ; 2 ; 3 ; 0 ; 0 ; 0 ; 0 OVERSOLD 

IMPORTANT 0;5 ; 2 ; 0;2 ;0; Q ; 0 ; 2 UNIMPORTANT 

8, Relationship to other course offerings of the college and to 
other professors on campus: 

REPLICATION O t O t O i O t O t O : l ; Q;ll UNIQUE 

0 i 0 : 0 : 0 : 0 : 0 : l t 3 ; 8 STIMULATING 
IMPORTANT 7;3 t 2 t 0:0 t 0 t 0 t 0 t 0 UNIMPORTANT 

GOOD 7 t 3 t 2:0 t 0 : 0 t 0 : 0 i 0 BAD 

ACCEPTING 7 : 3 : 1 il t O t O t O t O t O REJECTING 

9* Experience in dealing with people, classroom observance, working 
with school pupils (kindergarten through 12), awareness of 
teaching conditions: 

HELPFUL 11 : 1 : 0 : 0 : 0 : 0 ; 0;0 ; 0 UNHELPFUL 

RIGHT 7 : 2 : 2 : 0 : 1 ; 0 : Q. ; 0 ; 0 WRONG 

IMPRACTICAL 0 ; 0 : 0 : 0 : Q : 1 ; 0 : 2 : 9 PRACTICAL 

VALUABLE 8:3 : 0 : 0 : 1 : 0 : 0 : 0;0 USELESS 

REVEALING 10 : 1 : 0 : 0 : 1 : 0 : 0 : 0 : 0 STERECiYPED 

10. Preparation for education-related career: 

COMPLEMENTARY 10 : 2 : 0 : 0 : 0 : 0:0 : 0 : 0 UNRELATED 

EXCESSIVE 0 : 1 : 0 : 0 : 2 : 1 ; 0 : 1 : 7 SU?PLEMENTARY 

UNHELPFUL 0 : 0 : 0 : 0 : 0 : 0:0 : 2 : 10 HELPFUL 

IMPORTANT 7 : 5 : 0 : 0 : 0 : 0 : 0 : 0 ; 0 UNIMPORTANT 

PASSIVE 0:0:0:0:0:0;1:4:7 ACTIVE 



CONCLUSIONS 



Placement of Trainees 

With the existing void in the teaching ranks of skilled evaluators, 
exists a competitive field of placement for students having research 
skills* The role of evaluation technician has a place in education if 
adei][uate personnel can be trained to fill it. Teacher weaknesses in 
testing procedures, increased evaluation demands in federal programs, 
and expanding alternatives in educational programming have generated 
critical shortages in evaluation personnel. 



The undergraduate research training serves to supply educational 
Institutions with some of these technicians. There appears also to be 
an adequate routing of graduates toward doctorial-level study of research 
theory and methdology* The research-training undergraduates have few 
problems in fi n d in g financial support for further study. 



Program Future 

Research recruitment can be successfully started at the undergraduate 
level. Not only are the by-products of normal program attrition beneficial 
to the world of education, but also an adequate percentage of students 
continue research training on the graduate level. The students who 
continue will have the fiindamentals that are essential for the forwarding 
of research as a field of knowledge. 

At Memphis State University, the undergraduate program will be 
retained, but on a limited scope because of the extensive costs of the 
program. This limited scope should only be temporary because demand will 
soon overcome any reticence to commit larger stims to the program. In 
order to meet the needs of modem education with quality, heavy investment 
is often demanded for adequate training* As the current trainees validate 
the adequacy of their training, greater Investments will be forthcoming. 



APPENDIX A 



Evaluation Criteria 



Midterm, Education 4521 •• Introduction to Educational Statistics I 
Final, Ecucation 4521 * Introduction to Educational Statistics I 

Midterm, Education 4522 « Introduction to Educational Statistics II 
Final, Education 4522 - Introduction to Educational Statistics II 

Final, Education 4511 - Education Tests, Measurements and Practicum 

Application I 

Final, Education 4512 • Education Tests, Measurements and Practicum 

Application II 



Evaluation Criteria 
Midterm Education 4521 

Miss Jones was a fifth-grade science teacher in an overcrowded school. 
In order to develop a motivational force she allowed her class to pick 
a three-x^eeks topic and to select their ox^n methods of learning the topic* 
The class selected space travel and suggested that knowledge of space 
travel could be gained through reading, motion picture films, programmed 
learning, field trips, and simulation. Miss Jones wanted to take full 
advantage of the student's desire to learn so she devised an experimental 
treatment of the unit. She randomly divided the class of thirty-five 
into five groups of seven each and taught each group with one of the 
suggested methods. In order to find differences in the treatments she 
gave each group the same ten-item criterion test. The following results 
were obtained: 



Group I 


Group II 


Group III 


Group IV 


Group V 


(Reading) 


(Motion 


(Programmed 


(Field 




(Simulation) 






Pictures) 


Learning) 


Trips) 






Student Grade 


Student Grade 


Student 


Grade 


Student Grade 


Student Grade 


1 


9 


8 


4 


15 


6 


22 


8 


29 8 


2 


7 


9 


5 


16 


6 


23 


9 


30 8 


3 


7 


10 


5 


17 


5 


24 


6 


31 6 


4 


8 


11 


6 


18 


9 


25 


5 


32 5 


5 


6 


12 


8 


19 


7 


26 


4 


33 4 


6 


4 


13 


10 


20 


3 


27 


2 


34 1 


7 


5 


14 


10 


21 


10 


28 


10 


35 9 



1. Describe Miss Jones; experimental design. 

2. Discuss ways of improving the design using the same sample. 

3. Uhat was meant by using the experimental design to take advantage 
of the students' desire to learn? 

4. Calculate the classes' mean and variance. 

5. Calculate the sampling error variance for each group. 

6. Calculate the mean for each group. 

7. Calculate the between groups variance? Can this variance be classified 
as experimental variance? 



Evaluation Criteria 
Final Education 4521 

I. Ihe following is an excerpt from the study done by W, W, Charters, Jr, 
at Washington University and printed in the American Educational Rese arch 
Journal, Vol. II, So, 3, May, 1965. The study is titled, ”The Relation 
of Morale to Turnover to Teachers." 

Studies of industrial morale conducted by the survey research center 
of the University of Michigan a number of years ago showed that morale, 
as conventionally measured, consists of at least four factorially indepen- 
dent dimensions - intrinsic Job satisfaction, satisfaction with the 
employing company, liking for the supervisor, and satisfaction with 
one s nobility within the company (Kate and Con, 1952). In a recent 
study, the author constructed brief, cumulative scales to measure the 
first two of the components of morale in the educational setting 
(Charters, 1964). One scale measured intrinsic satisfaction derived 
from teaching; the other, the teachers identification with the school 
system. While these scales showed meaningful relationships with other 
attitudinal and background variables in the initial study, it seems 
advisable to seek stronger validation of the measures by examining their 
capacity to predict teacher movement out of the school system. The 
present article reports on the occupational status of 538 classroom 
teachers, three years after they have been measured on the two scales. 

When the follow-up study began, the investigators planned to predict 
differential predictions from two scales regarding the direction of 
teacher mobility. They expected that with a teacher that is high on 
identification with the system and low on satisfaction of teaching 
would move into administrative or other staff positions within the 
same system; while a teacher who is low on identiflcatinn with the 
system but high on satisfaction with teaching would move to classroom 
position in other school districts. Teachers with low scores on both 
scales were ^pected to leave education altogether or at least both 
the system they were in and classroom teaching; and those hi^ on the 
two scales would be immobile. Unfortunately, it was not possible to 
test the ability of the scales to discriminate among the various kinds 
of mobility, too few teachers have made the necessary kinds of moves. 

Only five teachers, for example, have moved to non- teaching jobs within 
the system. Consequently, the study was limited to examining the rela- 
tionship of each scale separately to the simple incidents of movement 

out of the system during the three year period, ignoring the destination 
of those that had moved. 

1. Ignoring Dr, Charters' disappointment with the lack of mobility in 
his sample describe a research design which you might envision 
being used in the study of this problem. 



2, In the analysis of the data that Charters had collected for this study 
he used basically a comparison design for analysis. In his design 
he categorized by males* single females, and married females, the 
teachers in the sample. He then proceeded to test the difference 
between the means of those who remained in the system versus those 
who left the system. His analysis between mean differences was made 
by one tailed t**tests. Describe the appropriateness or lack of 
appropriateness of this statistical treatment, 

II, The text utilized in the research training class. Foundations of Behavioral 
Research by Fred M, Kerlinger has been reviewed by several reviewers, 

Don Medley of the University of Nei7 York in reviewing the book states: 

The concept of the "scientific approach" put forth in 
the first two chapters of the book seems to be something like 
this: science proceeds by (1) proposing hypothesis deduced 

by theory (or other hypothesis); (2) testing the hypothesis; 
which (3) shows the hypothesis to be "probably correct" or 
"probably incorrect;" and (4) confirms (or refutes) the theory. 

The construction of theory is ths ultimate goal of science 
to the present review?; this seems to imply that the probability 
is interpreted as referring to subjective probabilities, that 
is the strength of belief that the scientist feels in his 
hypothesis and his theories, and that the whole idea of science 
is to strengthen that belief. This position is inconsistent 
with the point of vim that least some behavior scientists 
which goes something like this: science proceeds by 1, pro- 

posing a hypothesis (which may be based upon theory) that is 
"exact" - that is, from which the results for an experiment 
can be predicted and 2, whose rejection will necessary imply 
the acceptance of some alternative to the hypothesis (usually 
only the hypothesis that fits these conditions is a null 
hypothesis); 3, conduct an experiment and reject the hypothesis 
if the results are inconsistent with the prediction; and if 
they are 4, accept the alternative hypothesis. Theory is 
built out of such indirectly supported hypothesis. No prob- 
ability can be assigned to the truth of a hypothesis except 
one (If it is true or if it is false), 5, prediction of 
behavior; theories generally improve the ability to predict 
and are therefore useful as means to an end, but not in them- 
selves. 



’*'n the review of the Kerlinger book, a reference is made to the interpre- 
tation of randomization by Kerlinger, 

Kerlinger 's basic point of view leads to a variety of 
unacceptable positions to a reader who disagrees with his 
philosophy of research. For example, the role of randomization 




n. 



is described as that of equalizing charazteristics not other- 
wise controlled; if data is submitted to a randomization 
process or distributed according to chance expectations, it 
is correct to say "that the principle of randomization has 
operated successfully." 

To one who sees a purpose of randomization as validation 
of the estimate of error it is nonsense to talk about random- 
ization as successful or unsuccessful. Is it not the role of 
the test of significance or the level of competence to allow 
for the ever present possibility that randomization has not 
been "successful?" 

1. React to the disagreement of Dr. Kerlinger and Dr. Medley concerning 
"scientific approach." 

2. Explain the differences in the two philosophies toward randomization. 

III. Compute Between, Within, and Total Variance for these three groups: Is 

the experimental variance greater than the error variance? 



1 
8 

7 
5 
4 
3 
9 

12 

11 

8 

2 



11 
1 
4 
6 
8 
9 

12 
1 

7 
6 

8 



III 

5 

4 

3 

2 

1 
8 
9 
7 
3 

2 



IV. Correlate the two frequencies: How much variance of x can be 

explained by y? 



X 



y 



21 

36 

12 

15 

18 

12 

20 

15 

7 

8 



20 

30 

15 
18 

16 
9 

19 

14 

10 

10 



20 ' 



Evaluation Criteria 
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1* Define: independence, mutual exclusion, and exhaustiveness. 

2. Suppose that you are sampling ninth-grade youngsters for some 
research purposes. There are 250 ninth graders in the school 
system, 130 boys and 120 girls, 

(e) VRiat is the probability of selecting any youngster? 

(b) l^at is the probability of selecting a girl? A boy? 

(c) What is the probability of selectin-: either a boy or girl? 

(d) In a sample of two children what is the probability of 

selecting first a boy and then a girl? 

(e) Suppose you drew a sample of 100 boys and girls. You got 

90 boys and 10 girls. What conclusions might you reach? 

Why? 

3. An educational investigator drew a random sample of 64 ninth- 
grade students in a junior high school and asked them if they 
favored monthly conferences with their homeroom teacher. Of the 
64 students, 40 said Yes, 

(a) Is this a "real” majority opinion? Is it a statistically 
significant response? 

(b) Test the response for significance. Use X^, and assume 
equiprobability (that is, if the students answered Yes and No 
at random, what responses would you expect to get?) An 

as great as, or greater than, 3.84 is significant at the .05 
level, 6.64 at the .01 level. 

(c) Test the response using binomial statistics and the normal 
probability curve. (Use Kerlinger Chapter 10). 

4. X « 150, Sjj *28, n * 16, test the h3rpothesis that u « 135. Compute 
the value of t and tell what you do with the hypothesis. 

5. Suppose an experimenter believes that the number of pellets rats 
will eat in a 10-minute period is related to the length of time 
since they last ate. To test his h3^othesls he randomly selects 
three groups of six rats each. After giving each group pvellminMsry 
training he tests group 3, 3 hours after eating; group 12, 12 
hours after eating; and group 24, 24 hours after eating. The 
results of his experiment are presented below with the data 

being the number of pellets eaten by each animal in a 10-minute 
period. 






GROUP 3 




GROUP 12 


GROUP 24 


0 




5 


5 


7 




2 


11 


2 




3 


9 


1 




3 


9 


i 




5 


4 


7 




5 


10 


(a) What statistical analysis is in order? 




(b) Describe the assumptions required by this analysis. 


(c) Analyze and interpret 


the data. 




Do a double-classification ANOVA on: 




Reading Scores for 


a Stratified Random Sample 


Location 




Sex 






M 


P 






4 


1 






9 


4 




URBAN 


9 


5 






10 


6 






3 


4 




RURAL 


7 


4 






7 


8 






7 


4 




Compute the product-moment 


correlation between 


shoe ‘Size and 


height in inches. 








SUBJECT 




SHOE SIZE 


HEIGHT 


1 




9.0 


70 


2 




6.5 


62 


3 




8.0 


66 


4 




7.5 


69 


5 




8.5 


72 


From « 1 I(X-X)2 


derive S^ - IXX^-X 




n 




n 




Koenker, in his study of arithmetic readiness. 


reports, among other 


data, difference scores. These scores are the differences between 



v*tc 4.a.ua4. 5 «iM otu 4 «B u£ cne maccnea pairs or nis experimental and 
control groups on an arithmetic test. Among the 27 scores, 24 
are positive and 3 are negative, that is, 24 of the experimental 
group S made greater gains than their control** group partners did, 
and 3 of them did not gain as much as their control-group partners 



(a) Use the sign test (14.1-14.3-14.4 Kerlinger) to test the 
significance of the result. Interpret. 

(b) Koenker reports a t ratio of 5.23, significant at the .01 
level - actually significant at the .001 level. How does 
the result of the sign test compare with the t-test? 

Miss Jones utilized two methods of feedback on her written comments 
being returned with a diagnostic test. In the examination of the 
class, Miss Jones wished to see if Treatment A, praise centered 
comments, produced better grades than Treatment B, blame centered 
comments. The scores on the examination were: 



Treatment A Treatment B 

3 6 

5 5 

2 7 

4 8 

6 9 

2 4 

7 7 

Random techniques were used 8 

9 

7 



If a large population is to be studied by choosing a sample from it, 
are the two major requirements that must be met in selecting the 
sample? What kinds of useful conclusions depend for their justification 
on carefully satisfying these requirements? 

A jux^r hearing a murder trial is working through the evidence toward 
a decision centered on the hypothesis: The defendant is not guilty. 

What two errors are possible in the decision, and which is the most 
serious? Justify your answer. 

What are the reasons for the almost universal use of critical regions 

of sizes .05 and .01? Would any of these reasons be valid arguments 

against the use of regions of size *03, *07. or .20? State your 
reference. 

In a study of teaching mejthods the following data was found: 

Traditional method X * 75,f/x * 5.4, n » 30 

Experimental method Y «« 79, ^y = 5.1, n* « 32 

Using X e .05 as in the example, decide whether to accept or 
reject Ho: ux * uy. 
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. A teacher with 135 students estimates on the basis of past experience 
that twenty students will earn an A, twenty-five a B, forty-nine a C, 
twenty-five a and sixteen an F. The grades given at the end of the 
term included fifteen A*s, twenty-one B*s, forty-two C's, thirty-one D's, 
and twenty-six F's. 



(a) Frame suitable null and alternative hypotheses which may 
be tested using the test with »«(.05. 

(b) Find X^ and the number of degrees of freedom. 

(c) What conclusions or decisions can be made concerning the 
method of estimating grades and the class to which the 
method was applied? 



16. Plot a scattergram and compute a correlation coefficient for: 



17. 



Student Number 
1 
2 

3 

4 

5 

6 

7 

8 
9 

10 

11 

12 

13 

14 

15 

16 
17 
16 

Find rank order r 

X 1 2 3 4 5 
Y 4 11 3 12 2 



English Grade 
94 
89 
85 
81 
79 
78 
76 
75 
71 
70 
68 
65 
60 
57 
55 
49 
48 
39 

for the rankings: 



Vocabulary Grade 
92 
90 
78 
85 
81 
83 
75 
74 
82 
69 
71 

63 
58 

64 
58 
52 
45 
35 



6 7 8 9 10 11 12 13 14 15 16 
1 13 7 14 6 5 15 10 16 9 8 



18. An urn contains six red and four black balls. Two balls are drcwn 
without replacement. What is the probability that the second bkll 
is red if it is known that the first is red? 

19. Given the samples (1.8, 2.9, 1.4, 1.1), (5.0, 8.6, 9.2) from normal 
populations, test whether the variances are equal at the .05 level. 







20. The following data satisfy the two-way classification model 



Yij - u + di + 6;: + 1 = 1, 2, 3, 4 

^ j = 1, 2, 3, 4, 5, 6 




TOTAL 



Evaluation Criteria 

Final, Education 4522 

1. The twentieth century is increasingly demanding people with high 
levels of education. In the future the lowest level of education 
and competnece will be above what it is today. Much educational 
practice in the United States assumes that only a limited proportion 
of American youth is capable of high level educational attainment. 
Such an assumption may drastically limit the production of necessary 
education personnel. 

The student's self-concept of his ability as a school learner may 
limit his learning and may prevent his achievement of a higher 
educational level. Theoretical support for the investigation of 
self-concept is found in the writings of Mead, Combs, and Snygg. 
Research has indicated that there is a consistent relationship 
between self-concept and behavior. It is hypothesized that the 
child performs in the manner that is consistent with his self-ccncept 
which is acquired during Interaction with significant others who hold 
expectations of the student as a learner. (From pp. 280 - Galfo and 
Miller, Interpreting Education Research ;. 
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An elementary school system has volunteered to allow you to use 
their forty-two third grade classes (average thirty) for three years 
to study the relationship of self-concept to academic achievement* 
Describe the hypotheses, variables, procedures and analyses which 
you would utilize given this opportunity. Critique your design. 

2. The term *‘team teaching" has been used in recent years to describe 
processes by which pupil instruction becomes a group rather than an 
individual effort. Unfortunately, although some research has been 
made on the use of team teaching, there still is not much information 
available concerning many aspects of the concept* Apparently the team 
idea has evolved from research into the general area of teacher 
utilization. (Galfo and Miller, 319). 

A junior high school district has contacted you to aid them in planning 
staff innovations centered around team teaching. They wish to establish 
the most appropriate formats, organizations and procedures available 
in their team teaching system. Unfortunately, there is little infor- 
mation available which mi^t indicate the ways which team teaching 
can best be utilized in their district. Aid them by designing a multi- 
group experimental study using their sixty junior high schools and 
providing them with eopirlcal data which they may use in answering 
questions concerned with teacher morale, student achievement, and 
adminis t ratlve f rus tra t ion . 

3. Flexible scheduling offers to the student independent study time 
rather than study hall periods. In independent study the student is 
offered freedom of movement, opportunity for personal scheduling of 
work time, opportunity to use study carreJsor resource centers, and 
choice of study modules. Design a descriptive study which would add 

to the current state of knowledge concerning independoj- t study; stating 
problem, hypothesis, analysis, and anticipated roadbl’cc^s as'^timing an 
unlimited sac^le. 

4. Design an experimental study using the same problem but restating the 
hypothesis, design procedures and analysis in proper form. 



PLEASE: Write a candid and factual evaluation of the course and 

program. Include strong points, weak points, and suggested revisions. 
Has the program altered your career aspirations? Do you think you 
will seek further.. learning and future occupation in research? Thif 
can be turned in eaonymously if desired. 



Evaluation Criteria 
Final, Education 4511 

This problem is to be solved by two of you working together. Using 
the following data, tabulate the scores and group the data according to 
the standards suggested in class and determine the following: 



A. Median score 
B* Mean 

C. Standard devlstlon 



'rhree formulas are offered as suggestions: 





You may use the calculator or any books or notes handy (in 
office) to assist you. 



The scores are fictitious: 



22 


15 


13 


24 


26 


75 


41 


45 


23 


56 


35 


29 


7' 


74 


63 


15 


48 


37 


36 


1C 


14 


88 


42 


59 


31 


57 


72 


25 


55 


78 


58 


25 


58 


42 


36 


12 


45 


45 


16 


35 


48 


78 


45 


26 


75 


92 


64 


59 


56 


25 


13 


36 


53 


67 


67 


23 


36 


12 


26 


56 


12 


37 




9o 


53 


15 


65 


95 


38 




98 


50 


24 


23 


63 


24 




52 


60 


25 


34 


68 


35 




52 


88 


85 


68 


45 


19 




12 


91 


76 


97 


78 






45 


50 


13 


65 


76 


53 




23 


60 


23 


34 


16 


'/4 




23 


55 


56 


39 


23 


85 




56 


48 


45 


36 


58 






48 


75 


78 


58 


59 


63 




19 


42 


15 


53 


49 


52 





The preparation of a test or scale is like an irr.pcrtant speech 

or research report for publication. The first draft is completed after many 
hours of research, reading, writing and re-writing. Finally, an experi- 
mental draft is prepared, after a pilot study, and the instri’.r»ent is 
administered to an experimental group frequently numbering in the thousands. 
The results are then analysed to determine whether or not chang-,:.? should 
be made. Assume all of the above procedures have been complet ed and you 
ere at this stage of development in the Instrument construct. ion. Jse your 
project. 



What would you do now? 



Be very specific and illustrate wherever possible such as how you 
would ' word the changes, etc. 

A. General foraat 

B. Instruction for administering 

C. Answer form 

D. Item content or wording 
£• Scoring 

F. Sample respondents 

G. Analysis of results, standardization 

H. General treatment of the topic or subject. (Do not suggest a 

new topic or subject—assume your assignment was to construct an instrument 
just as you chose.) 

Following are examples of test items prepared by students concerning 
the subject matter of Chapter 23 in the text. All items are in the form 
of definitions. Each was prepared to Include one correct response. Choose 
the best response (if one does exist) and prepare a third response that 
is not a proper response but is plausible. If no correct response is 
Included in the example, prepare the third response as the correct 
response. Try to avoid changing the wording of the opening statement but, 
if in your opinion, a proper response can not be made to the statement, 
change the statement and re-write all three responses. The textbook and 
the dictionary may be used as you see fit. Be sure to clearly indicate 
the correct response. Select any fifteen. 

1. Variability could best be classified as: 

a. either reliable or unpredictable 

b. inconsistent 

2. In unreliable instruments, the addition of items of equal kind and 
quality will be more likely to produce: 

a^ greater systematic variance 
b. greater reliability 



3. The square of the coefficient of correlation is: 

a. the coefficient of determination 

b, the reliability coefficient 



4. All valid scores most likely include: 

a. an error component 

b. the true score 



5 . 



The first and most elementary step in any measurement procedure Is toj 
a. define the objects of the universe of discourse 
b* define the properties of the objects of the universe of discourse 



6, In the absence of sufficient criteria, when we say two objects are the 
"same" we mean: 

a« they are identical 

b* they are sufficiently the same to be classed in the same set 



7. An example of a transitivity postulate is; 

a. A>B<C; AiC 

b. A>B>C; kyC 



8, The range in measurement is: 

a. the objects being measured 

b. numerals assigned to the objects being measured 



9« A construct is: 

a. an operational definition 

b. an invented name for a property 



10* The measurement ideal is: 

a. the ratio scale 

b. the equal-interval scale 

11. If (a«b) and (b«c), then (a*c); this postulate expresses: 

a. transitivity 

b. equality alone 



12. A construct is: 

a. usually arbitrary 

b* the same as "the reason for" 

13. A function is: 

a. a relation in which with a given first element, there are 
never two different second elements 

b. a relation in which two ordered pairs have the same first 
element and different second elements 
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14« An ordinal number: 

a* cells the position of an object in a particular linear 
sequence or succession 

b. Indicates absolute quantities which are positioned according 
to their total value. 



15. Equal- Interval scales are characterized by: 

a. equal distances on the scale representing equal distances In 
the property being measured 

b. measurement taking place at equal Intervals of time 



16. In which of the following does ti»e word "figure(s)" refer to a numersl? 

a. "This measurement has three significant figures." 

b. "The figure In the ten's place Is wrong," said the teacher. 



17. Nominal measurement: 

a. assigning symbols which have qualitative but not quantitative 
meaning to sets of objects 

b. Is estimating the actual measure of something 

IS. An action taken to Infer some unobservable characteristic Is: 

a. an Indicant 

b. a construct 



19. A postulate Is: 

a. an unproven law accepted on faith, unrelated to theorems 

b. an assumption necessary to forward movement of a project 



20. Measurement Is the: 

a. assignment of numbers to objects or events according to rules 

b. assignment of numerals to objects or events according to rules 



21. Ordinal numbers : 

a. tell "how many" 

b. tell ’*whlch one" 



22. A division of the universal set into subsets that are disjoint and 
exhaustive Is: 

a. a partitioning of U 

b. a means of limiting the variables of U 
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23. A cardinal property of a number is that property that a math set has 
in common with all sets that can be put into a* 

a. 1 to 1 

b, 1 to 2 correspondence 



24. Measurement in the broadest sense is: 

a. the assignment of numerals to objects or events according 

to rules 

b. the accessment of values given to any object or event 



25. The classes El and Ell correspond to: 

a. the domain 

b. the range 



26. Superior intelligence, bright and higih achiever 

In the above example the word indicant applied to: 

a. ’’superior intelligence, bright and high achiever." 

b. his class standing and scores test situations 



27. Superior intelligence, bright and high achiever 

Using the above example the word construct applied to: 

a. "superior intelligence, bright and high achiever" 

b. John’s grades and the fact that he is in the upper 3% of 
his class 



28. Partitioning a set consls'-s of: 

a. breaking it down into subsets that are mutually exclusive 

and exhaustive 

b. defining the objects of the universe of discourse 



29 . liicho tomous : 

a. having only 2 values 

b. having various subsets 



The subject of tests and measurements is characterixed by a differ- 
entiation between reliability and validity . The end product of the subject 
is a matter of inference . Discuss the relationship that exists among these 
three concepts. 
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Write an opening statement and a series of at least three funnel 
questions that could be used in an interview schedule leading up to the 
question: “How did you receive improper help on the examination you were 

given in the chemistry final exam?" 



Select another member of the class for observation and during the 
course of the evening, record at least ten observations of that person 
from which one could infer a behavioral construct. 



Evaluation Criteria 
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Instructions t Mark each answer in the space provided at the left margin 
of the paper or on the line provided. Questions requiring written comment 
may be continued on the reverse side of the question sheet. Be sure your 
name appears on each page. Unless otherwise stated, pupils are considered 
to be the target population. 

Questions 1-15 : Three research studies (A, B, and C) are briefly described. 

Following each study is a series of five test items asking you to indicate 
the t 3 Tpe of study followed by a series of statements for which you are to 
Indicate whether the conclusions stated are permissible or not permissible. 
Use "P" for each permissible statement and '*HP" for each not permissible 
conclusion. Assume that differences reported under "Findings" for each 
study are statistically significant. Assume also that the sample of 
subjects for each study is representative of the population about which 
the statements are made, 

* * * 



Study A . 

Question : Is the number of counseling sessions with high school counselors 

related to student matriculation in college? 

Procedures ; Researcher counts number of counseling sessions recorded 
(the records are accurate) on each subject's completed high school 
Counseling Record Card and compiles on accurate record of the number 
of subjects who matriculate in college. 

Foldings : The greater the number of counseling sessions, the greater the 

number of students matriculating in college. 

* * ★ 
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1. Indicate whether this is a status study, an associatlonal ftudyi 
or an experioiantal study. 

2. The number of students matriculating in college will increase If 
each student is given an increased number of counseling sessions* 

P or NP. 

3. More counseling sessions result in greater student matriculation 
in college. P or NP 

4. There is a positive relationship between number of counseling 
sessions and student matriculation in college. P or NP 

5. Some students matriculate in college because of having an 
increased number of counseling sessions. P or 17P. 

* * * 

Study B . 

Question ! Is the type of advice about college attendance that a couneelot 
gives to the student related to student matriculation in collegit 

Procedures ; Researcher randomly assigns one-third of all high school senlori 
to Group X, one-third to Group Y, and one-third to Group Z* 

Counselors tell each Group X student about college and advise 
each student to attend. Counselors tell each Group Y student about 
college but do not give advice about whether or not the student 
should attend. Group Z receives no counseling or advice about 
college. Records are maintained to indicate which students from 
each group matriculate. 

Findings : 450 Group X students matriculate 

300 Group Y students matriculate 

300 Group Z students matriculate 

* * * 

6. What type of study is this? (Status, associatlonal, or experimental) 

7. Counseling that includes ’’attend college” advice to the student 
results in an Increase in the number of students matriculating 
in college. P or NP 

8. More students advised by counselors to attend college matriculate 
than do students not given counselor adlvce about whether or not 
to attend college. P or NP 

9. Some students matriculate in college because they receive 
counselor adlvce to attend college. P or NP 
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1 0. The number of students matriculating in college will be greater 

if students are advised to attend college than if they are not given 
much advice. P or NP 

* * * 

Study C. 

Question: Is the number of students matriculating in college related to 

socio-economic status (SES)? 

Procedures t In the same high school, 100 students are randomly selected 

from high SES, 100 from medium SES, and 100 from low SES, A record 
is maintained to indicate which students from each group matriculate 
in college. 

Findings : 82 High SES students matriculate 

54 Medium SES students matriculate 
27 Low SES students matriculate 

* * * 

11. What type of study is this? (Status, associational, or experimental) 

12. Changing the social class of a group of 100 students from low to 
medium will increase the number of students from that group who 
matriculate in college. P or NP. 

13. Socio-economic status is positively related to matriculation in 
college. P or NP. 

14. Some students matriculate in college because they have high 
socio-economic status. P or NP. 

15. The higher the socio-economic status of a given group of students, 
the greater the probability that students from the group will 
matriculate in college. P or NP. 

In the following indicate your choice of reply by indicating the number in 

the space provided. Select the best reply for each Item. Use for 

"none of these”. 

16. Which variable in the three studies above is an independent 
variable? 

1* Number of counseling sessions 

2. Student matriculation in college 

3. Socio-economic status 

4. Type of advice about college attendance 
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17. Which variable in the three studies above is a dependent variable? 
!• Number of counseling sessions 

2. Student matriculation 

3. Socio-economic status 

4. Type of advice about college attendance 



.18. All of us are concerned these days about children's problem- 
solving abilities. Great claims have been made about the potency 
of the newly developed Mental Flexibility Training Program in 
improving problem- solving achievement as measured by standardized 
problem-solving tests. You therefore design an experimental 
study to compare the Mental Flexibility Training to the Ordered 
blinking Program (which your district currently uses) in terns 
of their effects on problem-solving achievement. What is the 
dependent variable in your study? 

1. Type of training program 
2« Mental Flexibility Training 
3« Problem-solving achievement 



19 • What is the independent variable in the study described in item 18? 
!• Type of training program 

2. Mental Flexibility Training 
3« Problem-solving achievement 



20. Which' one of the following is not usually considered a threat to 
the internal validity of an experiment? 

1. History 

2. Reactive arrangements 

3. Selection 

4. Mortality 



21. Suppose you have two intact classes available, both tau^t by the 
same teacher, and wish to test the efficacy of a particular visual 
aid In instruction. For each unit through the semester the aid 
is assigned randomly to one class or the other. At the end of a 
semester, the units taught by visual aid are significantly 
superior to those taught without. You can generalize the results 
to presence of the aid in general under which of the following 
assumptions? 

1. No interaction exists between treatments and any of the 
specific variables such as teacher, or class, etc. 

2. This teacher is an average teacher and the class is 
an average class. 

3. No interaction exists between maturation and history. 

4. The classes, although intact, are essentially equivalent. 
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When the results of an experiment are true only under certain very 
special conditions and do not generalize far beyond the particular 
experimental conditions, the experiment is said to have 

1. low internal validity 

2. high internal validity 

3. low external validity 

4. high external validity 

Which one of the following is usually considered a threat to the 
internal validity of an experiment? 

1. Interaction of testing and treatments 

2. Multiple treatment interference 

3. Regression 

4. Reactive arrangements 

One is interested in ascertaining if distribution of an exercise 
pamphlet in a secretarial pool causes the weight of each woman 
to decrease. Each woman was weighed before and after the distribu- 
tion of the pamphlet. On an average, each woman’s weight had 
decreased. Therefore, the conclusion was that the exercise 
pan^hlet Induced the women to lose weight. This example 
Illustrates the experimenter’s neglect of which threat? 

1. History 

2. Regression 

3. Testing 

4. Testing and X- interaction 

In some speech studies of early childhood, the procedure was 
merely to listen to the spontaneous vocalizations of an infant 
end write down what was heard. The selective factor of auditory 
perception— listemers "hear" most readily those sounds that 
correspond to the phonemes of their own language— was not 

considered. What threat did the exDerimenter not give attention 
to? 

1. Maturation 

2. Instrumentation 

3. Multiple-X interference 

4. History 

It is possible to obtain internal validity without having 

1. reliability 

2. generalizability 

3. replicability 

4. variability 
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DIRECTIONS: Continuing to mark the correct onst^er on the test sheet, use 

the following designs to answer the questions below. X is 
some experimental treatment. R is the random assignment to 
groups. 0 is some observation of behavior. M Is equivalent 
materials. A broken line indicates the use of intact groups 
without random assignment. 



1. 0 ^^ 02030 ^ X O^OgOyOg 6 . 0X0 

2. 0000X0000 O^O 



0000X0000 

000000X00 

R 

3. 0000X0000 

0000 0000 



7. R 0 (X) 

R X 0 

8. R 0 (X) (0) 
R X 0 



R 0 

R 0 



4. Xj^O XqO XjO XqO X|^0 etc. 9. Present class X old 0 

5. M X 0 M^X^O M X,0 MX^O M^XO etc. Next year clasT lTnew“o 
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27. The particular advantage of design (3) over design (1) is that 

some atteo^t is made to control 

1. history 

2. selection 

3. mortality 

4. multiple-X interference 

28. The advantage of design (8) over design (6) is the comparative 
absence in design (8) of the danger of 

1. instrumentation 

2. interaction of selection and X 

3. multiple-X interference 

4. Interaction of testing and X 

29. Where one cannot control the treatment but can control the 
observation random assignment to the measurements, then one may 
wish to use which design of the panel? 

1. Design 1 

2. Design 2 

3. Design 7 

4. Design 8 



30. A teacher was interested in testing the value of having students 
use flash cards while learning new vocabulary words. She has 
only one class of thirty students to test. What design would be 

best? 

1. Design 1 

2. Design 5 

3. Design 7 

4. Design 10 



31, Your school district has been using a team teaching approach in 

ninth grade English for three years in each of eight hi^ schools. 
The superintendent wishes to know whether team teaching results 
in any greater learning chan a traditional approach. He makes the 
resources of the Research Center available to you and obtains 
permission for you to use ninth grade students in a nearby high 
school. These students are being tau^t ninth grade English 
by a traditional approach. The experiment is to run during the 
school year 1967-68. Choose the best design. 

1. Design 4 

2. Design 6 

3. Design 8 

4. Design 9 



32. 



A junior high school has had a probelm in pupil behavior. It is 
associated with pupil attitudes. The school institutes a series 
of discussion groups with representatives of each class participat- 
ing on several occasions. Each child will eventually participate 
five times. You will frequently measure the ongoing effectiveness 
of the progeam in changing pupil attitudes. Which design is best? 

1. Design 1 

2. Design 5 

3. Design 6 

4. Design 8 



33. A retention study is to be made with students who took BSCS 
Biology. About 750 sophomores (approximately 86 from each of 
9 schools) took BSCS and are still in attendance as juniors. 

Data are available on these students and an equal number of soph- 
omores who took traditional biology. What is the best design? 

1. Design 2 

2. Design 6 

3. Design 8 

4. Design 9 

34. A sixth grade teacher wants to see what effect* if any, fifteen 
minutes of vigorous exercise just prior to a reading lesson has 
on reading performance. The other three sixth grade teachers are 
willing to use the fifteen minute exercise. Which design is best? 

1. Design 1 

2. Design 2 

3. Design 5 

4. Design 7 



35-40, Mark 1 on your test sheet for any of the following instructional 
objectives which are properly stated. Mark 2 for any which are 
improperly stated. 

3 5. The student will develop Interest in leisure sports 

3 6. The student will accurately learn the best known works of Voltaire. 

3 7. The teacher will help the class to solve algebra problons 
correctly. 

3 8. The student will appreciate the key importance of algebraic 
approaches. 

3 9. The student will include ten supporting facts in a written 

persuasive paragraph. , 

4 0. The student will become familiar with how to write an essay using 
no reference but personal experience. 

* * * 

41-43, Mark 1 on your test sheet for each of the following that indicates 
a change in educational means. Hark 2 for each item that indicates 
a change in ends, 

4 1. Use new self-study pamphlets to teach current math topics, 

4 2. Drop biology course objectives dealing with sex education. 

■ 4 3. Use increased quantities of teacher praise in classroom discussions. 

* * 

44-46, Mark 1 for each dependent variable » 2 for each independent variable. 

4 4. The quality of students' essay examinations. 

4 5. Frequency of teacher's efforts to show pupils the value of the 
subject matter, 

4 6. Amount of time teacher threatens pupils with possible failure In 
the class. 

* * * 
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47-49. Mark 1 for each nanipulable variable, 2 for each non-manipulable 
variable. 

4 7. Number of pupils in class. 

Socio-economic class of pnprl. 

49. Parental level of education. 



* * * 

50-52. Mark 1 for each of the following treatments that is operationally 
defined. Hark 2 for each treatment that is not. 

50. Use of the Encyclopaedia Britaimlca Films. Inc . , Harvey White 

Physics Series in all "honors" physics class. Each daily film 
to be followed by fifteen minutes of class discussion led by the 
teacher. 

^51. Use of a four item multiple-choice review at the beginning of each 

class period. 

^52. An individually differentiated instructional scheme in which 

each learner is given instructional tasks consonant with his 
intellectual ability and experiential bakcground. 

* * * 

53-57. Mark 1 for each item below that could be employed as a criterion 
to evaluate educational programs. Mark 2 for each item that could 
not be used as an educational criterion measure. 

5 3. Tape recordings of how individual pupils respond to a surprise 

question by the school's vice principal: "What do you want to 

be when you grow up?" 

5 4. A listing of the non-school clubs voluntarily joined by students 
during their senior year in high school. 

^55. School attendance records. 



56. The age of learners. 

,57. Locally constructed tests of pupils' progress in spelling. 
* * * 
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58-63. Using the eight category scheme presented below, classify each of 
the following numbered items by writing the appropriate number in 
the space provided on the test sheet. 

1. Learner-behavior - natural stimuli - locally devised 

2. Learner-behavior - natural stimuli - commerically devised 

3. Learner -behavior - manipulated stimuli - locally devised 

4. Learner-behavior - manipulated stimuli - commerically devised 

5. Behavior product - natural stimuli - locally devised 

6. Behavior product - natural stimuli - commerically devised 

7. Behavior product - manipulated stimuli - locally devised 

8. ..Behavior product - manipulated stimuli - commerically devised 

5 8. An esramination of the annual tonnage of school litter found in 
the halls as an index of school citizenship. 

5 9. Inspection of student reading preferences by the amount of monthly 
wear on magazines available in classrooms during free reading 
periods . 

6 0. Use of Flanders' observation schedule for recording classroom 
behavior. 

^61. School attendance records. 



6 2. California Achievement Test Scores 

6 3. Pupil responses to teacher-made questionnaire regarding their 
normal home relationships with parents and siblings. 

* * * 

64-65. Write in operational terms two objectives that could be derived 
from the following educational objective: "To understand how 
climate and georgraphlc conditions have exerted an important 
influence on the social and economic development of man." Answer 
in the space provided on the back of this sheet. 



66-68. List and describe (in one sentence each) three procedures which can 
be employed to increase the probability that the requirements of 
the experimental treatments are met in classroom research and/or 
to determine whether the requirements were met. Answer on the 
back of this sheut. 
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PREFACE 



Tliere are, at the fingertips of the classroom teacher, innumerable 
opportunities for research which may be the source of additional 
Icnov/fedge and Insight Into many of the problems of understanding and 
advancing the teaching— learning process. V/lille everyone must operate 
v/lthin the limits of his or her teaching assignment, level of training Ift 
researcli techniques and necessary content background, the teacher can and 
should become ski i ted In conducting quality research in raany areas. 

Among the principal points of justification for such endeavors, 
professional growth and knowledge, problem solving and systematic theory 
building are especially v/orthy of consideration. But v/hatever purpose 
the research Is to serve, a statement of the underlying philosophy and 
rational Is indispensable. A systematic, thoughtful and vigorous 
approacn to the investigation is necessary If we are to expect a 
clear design and a valid strategy of attack. Only when tight and organited 
frames of reference are consciously employed v/lll the field of education 
move tov/ard quality research.* 



^Byron G. Massialas and Frederick R, Smith, ’*'Quallty Research 
A Goal For Every Teacher,- AppI led Research In Education. Totov/a, 
New Jersey j Littlefield, Adams & Co. 1965, Pp. 16-1*7, 



IITOODUCTIOi! 



Tlicrc v/cre thirteen senior students selected to participate 
in the Undergraduate Research Training Program at Memphis State 
University in the Pali-Spring Semester of I957-&0. TIic program, 
funded by the United States Office of Education under Title IV of 
the Elementary and Secondary Education Act, held as its primary 
objective the development of research av/areness and statistical 
ability In the students. 

Tlie first semester v/as devoted to: 

1. Developing basic skills in statistical procedures. 

2. Development and administration of test Instruments. 

3. Familiarization with proper methods for searching 
the literature. 

4. Development of an av/areness of the threats to validity 
present in most research studies. 

■niese courses v/ere under the pedagogical direction of Dr. Donald 
R. Tliomsen, Dr. Jimmie C. Fortune and Dr. Jack Miller. 

At the beginning of the second semester the students enrolled 
in Education 4512 (Educational Test and Measurements Practicum) and 
soon thereafter embarked upon the practicum phase of the program under 
the supervision of Dr. Thomsen. Tne class members Viere Instructed to 
conceive, design, tevciop. Implement and analyze an experimental 
research study to fulfill a major segment of the course requirements. 

Tlie class v/as divided into *!.eams of tv;o to four members and required 
to select their own areas of research independent of faculty advice or 
suggestion. L. 17. Joyner and C. H. Holland formed a two member team 
and proceeded to search for a practical and feasible area In v/hich they 
would be able to conduct a study. 

Joyner, concurrently engaged In his student teaching practicum at 
Bellevue Junior High School, was serving under Mr. Austin V7elsh in 
ninth grade General Science and Miss Mary Jordan In seventh grade 
Tennessee History. 

During the course of a discussion related to an upcoming test 
the questionable validity of a llBStJn^ situation v/as mentioned 

by Mr. V/elsh. After considerable dIscusViVn a preliminary searching of 
the literature v/as conducted; this effort failed to reveal any available 
research to substantiate clalrnv^. toward any viewpoint relating to this 
area of activity. It v/as thus decided that a potential for limited but 
quality research on this topic nid Indeed exist. Based on these 
preliminary conclusions, the Invest Igators decided to v/rlte a proposal 
for a related research project to be conducted In this area and set 
forth the limits that would be imposed on such an investigation. A 
study based on the determination of any relationships that night exist 
between student achievement and the week-day of test administration 
v/as decided upon. 



46 



The proposal^ written by L, Joyner and C, Holland^ v;as presented to 
Mr, Aust I n V/elsh, science teacher, and Mr. Gordon Giibert, principai. 

Mr, Welsh not only approved the study but also v/rote an endorsement to 
Mr, Gilbert requesting his very necessary approval which followed within 
twenty-four hours. 

During the course of the investigation Mr, V/elsh proved to be an 
indispensable member of the team not only acting in an advisory capacity, 
but also very actively contributing by the daily administration of the 
test and the carrying out of other tasks. Without his full cooperation 
and assistance this study would not have been possible. 



CONSEMT FOR THE STUDY 







During the time this writer was assigned to Bellevue Junior High 
School, for the purpose of performing his student teaching practicum, 
there v/as also a pressing need to secure permission to conduct an experi- 
mental study in some area related to educational research. The latter was 
a necessary requirement for Education 4512 under Dr, Donald Thomsen, 
Associate Professor, Memphis State University, Education Department and 
Assistant Director, Educational Information Systems, Central Midwestern 
Regional E»^ucational Laboratory, Inc., 3808 Norriswood, Memphis, Tennessee. 

V/hen the present area of study v/as first suggested by Mr. Austin Welsh, 
it v/as immediately given serious consideration by the concerned individuals 
and quickly adopted as the study to be conducted by these workers. 

A proposal for a research study v/as written and submitted to the 
following authorities for their necessary approval: 

^JA^E 



Dr. Donald R. Thomsen 



POSITI OM ACTI ON TAKEN 

Associate Professor Approval 

Memphis State University, 

College of Education and 
Assistant Director 
Educational Information Systems, 

Central Midwestern Regional 
Educational Laboratory, Inc. 

3808 Norrisv/ood 
Memphis, Tennessee 38111 



Dr. Jimmie C, Fortune Assistant Professor, 

Memphis State University 
College of Education , 

Bureau of Educational Research 
and Services 
Memphis, Tennessee 

Dr. Mosely Pov/ell Assistant Professor 

Col lege of Education 
and University Supervisor 
for Student Teaching Practicum 
Memphis State University 
Memphis, Tennessee 



Mr. Gordon Gilbert 



Principal 

Bellevue Junior High School 
Memphis, Tennessee 



Mr, Austin V/eish Instructor in General Science 

Ninth Grade 

Bellevue Junior High School 
Memphis, Tennessee 



Approval 



Approval 



Approval 



Approval 



The investigators named herein proceeded to conduct the study 
according to the general guide lines, requirements and limitations as 
set forth in the above named proposal and more fully described in this 
paper. ao 



CLIMATE— ENV I RONNCrr AND LEARNING ATT40SPHERE 



Bellevue Junior High School is a forty— one year old public educational 
facility In the Memphis City School System comprising grades seven, eight 
and nine. The original red brick structure has undergone limited modifica- 
tions and additions since its erection in 1927. For a building of this age, 
the state of repair is good. Tlie custodial and maintenance services 
furnisned by the city board of education are adequate. 

Teaching facilities appear adequate to meet minimal student needs, 
but there Is a significant lack of equipment in certain areas. There are 
several film projectors but very few television sets are available. This 
is true of most other types of audio-visual equipment also. The one 
facility short coming most closely related to this project v/as the 
absence of adequate laboratory facilities for the one hundred thirty nine 
students observed during the course of the study. The project v/as 
programmed around this deficit, hovfcver, and no major problems presented 
themselves In this area. 



THE STUDENT BODY 



The student body at Bellevue Junior High School is composed of six 
hundred eighty students, racially mixed, with approximately twenty percent 
Negroes throughout the classes.^ The transfer ratio Is significantly higher 
than for most other junior high schools in the city. 

SOC I C-ECONW I C BACKGROUND 



Tlic socio-economic background of the student population has declined 
steadily in recent years and at present a relatively low socio-economic 
status is In evidence for large number of the children. Bellevue v/as 
rated as a deprived area school last year and the principal and faculty 
feel that it should be so rated at this time. Additionally, the sexual 
distribution of the student population has recently shifted from a positive 
male balance to a negative male balance, and the average age levels of these 
minority male and majority female groups have increased. 

FACULTY AND OTHER PERSONNEL 



The ;taff is currently composed of twenty-seven faculty members, two 
guidance counselors, administrative personnel, one librarian plus cafeteria 
and custodial personnel. Ages vary and appeared to this observer to be about 
evenly distributed along a scale from early tv/enties to ainx/st retirement 
age. The faculty is predominately v/hite and female. There are tv/o Negro 
teachers, one male and one female. Ages of these tv/o instructors v/ere 



^This is an ‘‘offlclaN' estimate and according to Mr. Gilbert varies 
because of the high transfer ratio at this particular school. This 
percentage figure was more or less approximate throughout the five ninth 
grade General Science classes Involved in this study. 
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estimated by this observer to be middle or late tv/entfes. There seemed to 
exist 3 healthy and cooperative relationship between the latter and the 
rest of the faculty. Tensions v/ere not obvious and no outward feelings 
of a racial nature were ciserved. 

OTHER BACKGROUMD IrFORHATION 



These v/orUers fee! that, general ly, the rapport established with 
the children in the classes under observation was good to excellent. It 
is also felt that a major contribution to the excellent relationship with 
the students may be directly related to the student teaching practicum 
that preceeded the actual study. 

03SERVATI0MS REGARDIHG CLASS ATTITUDES 



Most of the students in the ninth grade General Science classes 
observed during the course of this investigation did not demonstrate any 
exceptional enthusiasm for the science material studied. Indications 
were that they took the course merely to fulfill the credit requirement at 
this level. There were a few exceptions In each class and these particular 
Individuals usually performed at levels well above class norms. 

Attitudes were generally good and, as previously stated, the rapport 
between students, teachers and researchers was excellent. This positive 
relationship v/as especially noticeable in Mr. l/elsh*s classes. According 
to unofficial reports and ‘educated guesses** among the faculty, the 
general performance of the majority of the student groups at Bellevue v/as 
usually belov/ expected norms for similar groups city-wide. Mo substantiating 
evidence was presented regarding this rather subjective observation by 
faculty and it Is mentioned here merely as an indicator of teacher attitudes. 
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HYPOTHESIS 



As stated previously, this study proposed to produce some 
evidence to indicate an optimum day of the v/eeU for classroom 
evaluation and testing. The working hypothesis for the experimental 
effort was therefore; THERE IS A SIGMIEICAKT REL/XTj ONSH I P BET\£EH 
STUDEHT ACHIEVEieiT Ai^!0 THE \7EEK DAY OF TEST ADlilHISTOvTION. The 
investigators further expected to obtain a definite focus of data toward 
one particular day of the v/eek. 



III 31i. problem 



It Is the understanding of these Investigators that the^e arc some 
students of human behavior, among whom, the concept of dally peaks In 
efficiency and performance In the Individual Is generally accepted. The 
Importance of learning and testing activities that would be associated 
v/lth any possible extension of this concept from an Individual-hour of 
the day basis to a group-day of the v;eek basis is obvious. 

if such an extension v/cre found to be valid and permissable then 
certain new approaches to learning situations, as v/cll as most classroom 
measurement and evaluation, may be indicated and should certainly be 
considered from a pedagogical position. Since* one of the major concerns 
of educators Is achievement by the student. It follows that awareness 
by the instructor of an existing optimum v/eek day for evaluat? and 
testing v/ould be a necessary and vital step toward Improved student 
performance in most areas of learning. A related consideration v/ould 
be the converse regarding a particular week day that might indicate 
minimal results or achievement. 

The selection of a definite day of the week for evaluation and 
testing in any particular discipline has. In the past, been based 
primarily on custom, tradition and teacher convenience. In many cases 
it has become an accepted practice to group testing situations into 
certain periods of time; such as, six v/ceks, semester and final 
examinations to coincide with administrative periods In the academic 
year. V/lthIn this structure, however, teachers are given certain latitudes 
In viliich to operate. Some teachers, for example, may not give a six 
v/eeks test but may compute grades from previous measurements. Others may 
give only six weeks examinations and so on. 

The study described in this paper v/as concerned v/ith gathering evidence 
in order to facilitate the establishment of norms or standards for making 
decisions related to test administration based primarily on a day of the 
week concept. 

One of the primary problems with \ 7 hlch these investigators concerned 
themselves v/as related to the almost universal aversion to administration 
of tests on Mondays. 

As Indicated elsewhere In this report, a search of the literature 
revealed no evidence of any research or controlled Investigation to 
substantiate such a policy. It is there* are concluded that the criteria 
for such practices are: 

1. Tradition and custom 

2. Uncontrolled classroom observations 

3. Teacher convenience and arbitrary selection. 

4. Hearsay and ‘experience.’- 

These situations are subject to all the threats to validity and reliability 
offered by sucli uncontrolled nonv-sclent If Ic methods of observation and 
measurement. 
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This study proposes to determine whether or not there is an 
optimum day of the week for classroom evaluation and testing, and If 
so to Indicate that measurements obtained on this day will reflect 
improved student achievement. 
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THE RESEARCH DESIGH 



After extended consultations v/ith Dr. Tliomscn and Dr. Fortune 
regarding the model for the research design it uas decided to use a daily 
testing situation incorporating short item quizzes Into a time series study 
in \ 7 hich the day actually became the sample observed. The data collected 
was then subjected to a sequential analysis of variance or an AIWA on 
the same cell recorded over the remaining days of the v/eek. 

The administrative problem of separating the lecture or presentation 
of content material from the test construction and recording v/as solved 
with the assistance of Mr. './elsh who presented Joyner a set of objectives 
which served as a guide to the selection of the test items. Mr. \7clsh 
then administered the tests while Joyner developed the test Items, scored 
and recorded the grades. 

ViTth minor modifications the design used in this study v/as constructed 
generally along the lines of v/hat Campbell and Stanley term COUITTERBALANCED 
designs. Counterbalanced designs are quasl-experlmental designs and Include 
all efforts in v/hich exper iraental control is achieved, or precision enhanced, 
by entering aJJ. respondents, or settings, into aJJL treatments. 

... such designs have been called 
•rotational experiments’ by McCall (ID23), 

••counterbalanced designs*- (e.g., Underv/ood, 

1949) "Cross-over designs (e.g., Cochran and 
Cox, 1957; Cox, I95C), and switch-over designs 
(Kempthorne, 1952)...^ 

live design is portrayed in the following diagram v/ith post-test 
only because it is especially preferred where pretest are unavailable or 
inappropriate as In the particular* study described herein. 
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X 0 
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Group E (Class Period ^/6) 


A 0 


X 0 


X A 


X p 


X 0 


Xai?o’'so“ 
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7* OF 7 L»EEk¥)'' 







R ~ Random assignment of pupils to comparison group. 

X = Exposure of students to an experimental condition. 

0 = Some form of observation or measurement. 

Broken Line == the broken lines betv/cen the lines signify the 
individuals In the groups v/ere not chosen at random; thus, the 
groups are not equivalent. 

^Dona Id f cVmpbe*lT* and Julian C. Stanley, Experimental And Quasl- 
Experimcntal Designs For Research, Chicago; Rand McNally & Company,p.50. 1966. 
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The coding here has specific meaning, \7henever X*s and O^s appear 
on a given line the application Is made to the same specific person. X*s 
and 0*s that are In a vertical relationship refer to a simultaneous same 
day application but to another person or persons. Randomization v/lthin 
groups permits the assumption the groups are equivalent. It v/as not 
possible, however, to achieve randomization In this study. Therefore, the 
groups are not equivalent. 

In this design the differences in sums could not be Interpreted simply 
as artifacts of the initial group differences or of practice effects, history, 
etc. Similarly comparable are the sums of the rov/s for Intrinsic group 
differences, and the sums of the columns of the first presentation for the 
differences In occasions."^ 

For the purposes of this study the counterbalanced design described 
by Campbell and Stanley, v/as modified so that the occurrence of each 
successive Monday, Tuesday, V/e'*nesday, Thursday and Friday became the sample 
for the (Experiment. Tlie data » *.orded were the Individual test scores and 
the class-period mean of these scores for each testing v/eek day became the 
prime observations for the experiment. 

The experimental treatment consisted of the dally administration of 
the five Item quiz on each occuring v/eek day. 

For purposes of this study the class-period gi oups v/ere non-equivalent. 
They were not ability grouped by the school prior to the study described 
herein. As In all quasi -experiments, strength v/as gained through consistency 
of Internal replications of the experiment as time allov/ed. 

The Investigators v/ere prone tov/ai*d a design of the type described 
here because of the lack of scheduling control over the relatively fev/ 
naturally aggregated groups of the classes. Unable to subdivide these 
natural groups Into randomly equivalent subgroups for either presentation 
of experimental treatment or testing, and after consultation v/lth Doctors 
Thomsen and Fortune, the investigators became fearful of threats relatec' 
to Interaction of selection and occasions. The possibility of such an 
occurence was deemed less likely in the modification of the counterbalanced 
design described herein, because all comparisons are demonstrated In 
each group, over each day, over each v/eek and hence several matched 
Interactions would be required to initiate the experimental effect. In other 
words, any such coincidental effects or threats v/ould have to occur on 
separate occasions, over repeated times. In each of the groups In turn. 



^ Donald T. Campbell and Julian C, Stanley, Experi mental And Quasl- 
Expc rl mental Designs For RcsejrcJi, Chicago: Rand McNaffy &**Company, p. 50. 

1966. 
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DEFINITIOMS Ai'JD LIMITATIONS 



For purposes of this study student achievement criteria was mastery 
of a limited number of concepts and factual knowledge. Standard grading 
techniques v/ere used. 

The test day was that particular day of the school week in wnich the 
testing instrument v/as administered to the sample groups. Briefly, five*- 
itern daily quizzes were used. 

TTie test instrument v/as considered as that instrument designed to 
measure student accomplishment and performance in the particular unit of 
study under consideration for each testing period. Tlie applied instrument 
v/as composed of written questions, short answers, true — false and completion. 
It evaluated acquisition of factual knowledge and understanding of concepts 
related to scientific subject matter at the ninth grade level. 

No effort v/as made to standardize or establish norms beyond those 
generally accepted for the material and grade level. 

The test made no specific effort to measure previous or general 
knowledge. 

The experimental treatment v/as defined as the v/eek day of test 
administration and v/as presented on a daily basis. 

For the particular purposes and needs of this study the individual 
student score v/as an Item v/hlle the arithmetic mean for the total group 
v/as the observation recorded as data. 

Under the conditions and the design of this study the sample v/as 
considered to be the actual v/eck day of test administration and occurred 
five times per class per v/eek, v/ith exceptions noted. 
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TEST DESI6M AbJD CONSTRUCT! OTI 



I. The design and construction of the test was based on an outline 
of objectives as presented to Joyner by Mr. Uelsh. 

Cr The Individual itenis v/ere placed on index cards— one Item per card* 
Answers and page references in text v/ere placed on the card In 
parenthesis. 

3. The source material for all evaluations v/as the text book for thit 
course as used In the Memphis City School System: V/lllard J. Jacobion, 
Robert N. King, Louise E. Killlc, and Cecilia J. Lauby^ Chal lenoes 111 
iejence (second edition), Nev/ York: American Book Company/" 1964* 

4. One hundred eighteen pages of material from units seven and eight In 
the text formed the content basis for the evaluation Instrument? used 
In the experimental treatment as applied to this Investigation. These 
seven chapters, tv/enty^-threc through tv/enty-nine, were primarily 
concerned v/lth human behavior and science In the home and cownunlty* 

5. The test design attempted was more achievement centered than aptitude 
centered, although the distinction betv/een these tv/o constructs Is 

by no means definite. In addition to being a measuring device It was 
also desired that the tests serve a motivational purpose that v/ould 
reflect positively for the Instructional phase of the study. The 
scoring v/as thus used as a method for i^ediate reinforcement by all&Wlhg 
the children to grade their own papers.^ Problems arose In this area 
that are more fully discussed elsev/here In this paper. 

6. Most mult iple*<*choice and short ansv/er Items v/ere constructed accordthd 
to reconinendatlons by D. A. Wood.^ 

7. Other elements considered important during test construction v/cre:^ 

A. Clarity of expression. 

B. Brevity of expression. 

C. Avoiding Irrelevant sources of difficulty. 

D. Technical terms as specific determiners. 

E. Avoiding Irrelevant Inaccuracies, 

0. The students recorded all answers to questions on a small quarter secttUh 
of paper approximately four Inches wide by five and one half Inches len§» 
Only the ansv/ers v/ere written by the students. 



^Due to the heavy work load of the research team members, this technique 
also served as a time saving device. 

^Dorothy Adkins V/ood, Test Con s tructio n. Columbus, Ohio; Charles E. Herrtil 
Books, Incorporated, 1961. Pp. Ii2-^. 

^ Ibicl .. pp, A4-^50 
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SUPPLIES AfJD EQUIR'ENT 



T!ie only extra supplies and equipment necessary for this study were 
small three by five index cards supplied by the investigators. The tests 
v/erc taken on the reverse side of old unused mimeographed class handouts 
gathered together for this purpose by Mr. V/elsh, These sheets v;ere cut 
Into four equal sections and distributed to the classes. Tlierefore, 
supplies and equipment necessary for this study v/ere furnished by the 
above named investigators at no expense to Bellevue Junior High School or 
the city school system. 



DATA GATHER I MG ACTIVITIES 



At approximately 0:50 on the morning of March 25, I960 the actual 
classroom investigation for this study v/as initiated among one hundred \ 
thirty nine, ninth grade. General Science students taught by Mr. Austin - 
V/elsh at Bellevue Junior High School, Memphis, Tennessee, 

The actual experimental treatment Vifas terminated at approximately 
2:30 P.M. on May 10, I960 after having been conducted daily, Monday through 
Friday for a total of seven v/eeks in all five science classes. During this 
period of time the investigators v/ere able to accumulate data for tv/enty- 
nine days of actual test administration. 



The sum of all data gathering activities over the seven v/eeks duration 
of this study resulted in a total of 3,473 in di yi dua ,l. experimental treatments 
on the follov/ing basis: 



PSyOD 



TES T ADMI MISTRATIOMS ( INDIVIDUAL) 



First Period 
Second Period 
Third Period 
Fifth Period 
Sixth Period 



740 Test Administrations 
786 Test Administrations 
763 Test Administrations 
601 Test Administrations 
583 Test Administrations 



Another point of interest to this investigator v/as the discovery, upon 
Initation of the statistical treatment, that during the course of this 
investigation, based on a 1:1:1 relationship a student confronted an item 
on a day for a Grand total of over seventeen thousand student— item-day 
encounters* according to: 



FIRST PERIOD; 


3700 


Student-item-day encounters 


SECOND PERIOD: 


3930 


Student- item-day encounters 


THIRD PERIOD: 


3815 


Student-item-day encounters 


FIFTH PERIOD; 


3005 


Student-item-day encounters 


SIXTH PERIOD: 


2915 


Student- item-day encounters 


TOTAL; 


17,365 


Student-iterjHday encounters 



It might be well to mention at this time that Mr, \7elsh considered 
the fifth and sixth period his 'highest performance’- classes.** Tlie 
reader v/ill notice that these tv/o classes also accumulated the lov/est 
student-item-day ratio of the five participating classes In the experiment. 



STUDENT AV/AREMESS OF THE STUDY 

Since it v/as felt that any unusual effort to prepare and achieve by 
the students would be randomly distributed throughout the week and not 
necessarily accrued consistently on any given day, the students v/ere made 
aware that some type of study v/as being conducted. They were not, however. 
Informed specifically regarding the nature of the experiment, but rather 



*Tfer*eafter referred to as; Student-item-days, 

** No substantiating data is included in this report to support this 
statement. 
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they were told that the study related to two areas? 

1. Improved student teacher performance, 

2. An attempt to alJow them (the students) to improve grade levels 
by repeated short Item quizzes on small areas o-f study.® 



E, Gadske, ’’A Comparison of tv/o Methods of Teaching First Year 
High School Algebra,** Sch , Scl . Nath , pp, 635-40, 1933. 
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PROCEtXJRES AI'ID TECHHIQUES 



THE EXPERIMEMTAL TREATfClTT 



Eor the purposes of this study, and In order that Internal validity 
Might be strengthened, it v/as deemed advisable to observe the folfov/ing 
procedural techniques ivhich were kept constant, v/henever and v/herever 
possible, throughout the experimental treatment. 



1. The experimental treatments v/ere administered each day at the 
beginning of the period. 

2. The time allov/ed for test completion was kept constant v/ithin 
ten to fifteen minutes — approximating a mean of twelve minutes. 
This time included: 



a. Reading the question. 

b. V/ritIng the ansv/er. 

c. Necessary grading and paper collecting 
activities. 



3. Efforts v/ere made to keep the climate as relaxed and informal 
as possible. 

4. The tests v/ere consistently constructed, scored and recorded by 
a member of the research team OTHER than the one presenting the 
subject content to the class. 



5. Assignments for outside of class study v/ere made daily — consisting 
v/henever and v/lierever possible of three pages of text material 
for each day^s study load. This ‘three page- goal v/as usually 
realized. Each three page assignment v/as cumulative through the 
chapter, I.e.: Monday three pages, Tuesday three pages, V/ednesday 

three pages v/ith testing as follov/s: Monday three pages, Tuesday 

six pages, V/ednesday nine pages and so on. This is explained more 
fully by the following chart: 

CLASS DAY - DAILY 



MATER I AL 
COVERED . 



Monday 

Tuesday 

V/ednesday 

Thursday 

Friday 



Three pages 
Three pages 
Tliree pages 
Three pages 
Tiiree pages 



Three pages 
Six pages 
Mine pages 
Tv/elve pages 
Fifteen pages 



6. The three page approach as used throughout resulted In a”staggerlng*‘ 
of the chapter beginning and ending days. Mo effort v/as made 
either to accentuate or dampen this effect. An early consideration 
v/as to intentionally stagger the schedule to avoid the pile up 
of chapter inlating activities on Monday and the chapter terminating 
activities on Friday. However, after consultation v/lth Dr. Thomsen 
It v/as- decided to Ignore this effect to secure a smooth flow of 
information over the testing areas. Upon adoption of the three 
page rule all assignments v/ere subjected to identical treatment and 



no emphasis v;as placed at any point. On some occasions an assignment 
could Include the Jast page or two of one chapter and the first page 
or so of the following — v/hatever was needed to fulfill the three 
page requirement. 

7, Each clay Mr. V/elsh v/as supplied with seven or mor e items on individual 
item cards. These cards were added to the previous day’s cards 
(for each chapter). The cards v/cre shuffled v/ell and five cards 
picked at random by some selected student. This v/as repeated period 
by period for all five classes of General Science each testing day. 

0. Item numbering v/as consecutive by the chapters. When questions 

v/ere drav/n randomly the number accompanied the question on the test. 

A five Item test ansv/er sheet might be numbered thus: 
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UlRE/TS TO VALIDITY IH THE EXPERHOIT 



Based on concepts from Campbell and Stanley, the folfov/Ing outline 
surnriiarizGs the major sources of invalidity as they pertain to this study. ^ 

A, Internal threats: 



1. History: 

Routine absenteeism presented a relatively small threat 
to this study so long as it remained more or less on a 
random basis. During, and because of, the recent civil 
disturbances In this city, hov/ever, absenteeism was no 
longer random, but related to a specific cause. More 
important — Its occurance concentrated on tv/o critical days 
In the study— Monday and Friday. Tills posed a real 
threat to the study: one that the researchers were pov/erless 

to control . 

2. Maturation: 



Ho specific control applied — but because of the relatively 
short duration of the study the researchers feel that there 
was a minimal cause for Invalidity from this source, 

3. Testing: 

Because there v/as no pretest data taken, the threat of 
testing as v/eJI as testing — treatment Interaction is not a 
relevant threat — no Interaction can occur JO Additional 
control was attempted In this ar^a through: 

(a) Random selection of individual five Inch by seven inch 
test item cards. 

(b) Consecutive three page content assignment, dally. In the 
regular course text book, 

4. Instrumentation: 



Tills was an area of genera! v/eakness and needs more consideration 
and attention In future studies. Lack of standardization was 
a continuing threat to the study. 




^Donald T. Campbell and Julian C. Stanley, Exicri mental And Quasi — 
LxperiRent ai Desj fj,ns For RejseAr clU Cli 1 cago : Rand ilcNaTlV S CompanyT pp. 5-6, 

40-41. 1966. 



PP. 



*®Exper I mental 
11-13. 



Des ion: 



Paradl.qms and Procedures (a class handout), 
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4. 1 nstrumcntat i on: 

Ihis v/as an area of general v/eakness and needs more consideration 
and attention in future studies. Lack of standardization v/as a 
continuing tnreat to the study. 

5. Regression: 

Ti'jis source v/as not a threat to this study since there was no 
pretest data taken and the groups were not selected on the 
basis of their extreme scores. Tlie use of mean differences 
throughout the study also offers a built In control in this 
area. 

6. Selection bias: 

Tliere Is the possibility of some degree of selection bias In 
the study because no effort was made to assign groups in a 
random manner, but rather to v/ork v/ithin the total frame work 
of ail five available ninth grade science classes that had 
been previously assigned for several weeks prior to the 
Initiation of this experiment. 

7. iiortallty: 

There v/as little threat to the study from drop-outs or out- 
transfers — only six such cases over the seven weeks period. 
However, the situations present on v/hich only partial data 
was available were more numerous. Tlie exper Imentors more or 
less ^'Sv/ept this under the rug,*- as per Campbell and Stanley.^* 

8. Selection — maturation interaction: 

As noted by chart on pane 75 this effect seemed not to present 
a major threat to the study since all groups seemed to conform 
to a very similar relationship with one another at the initiation 
and at the termination of the experimental treatment, even 
though there v/as no randomization of subjects. 

B. External: 

I. Testing and X-interact ion: 

Some ‘'senslt izing*' effect possibly occured during the early 
days of the study but since any particular day should receive 
a random chance of benefit In this area the threat posed to 
validity v/ac relatively small, and the control v/as based on a 
daily test at the same general time. 



II 



Campbell and Stanley, opi. cit . , p. 15. 



2. Selection and X-i nteract ion: 

Groups v/ere not randomly selected from the schools on a city- 
wide basis and Bellevue Junior High School is not equivalent 
to some of the ''better*' schools in the system because of a 
recent-years deterioration in the socio-economic background of 
the student body. Because of this, there may be a selection 
and /(-interaction threat to the general izabi 1 1 ty of the study. 

3. Reactive arrangements: 

These investigators felt that any efforts on the part of the 
students to alter performance as a result of situational 
knov-'ledge v/ould be randomly distributed over the Monday through 
Friday weekly testing span. For this reason the researchers 
did not consider that this source of invalidity posed a major 
threat to the study. 

4. Multiple /X- interference: 

Tlic researchers feel that this threat v/as under control 
because there v/as a one treatment per day design used throughout 
the experiment. 

5-6. Irrelevant responses and irrelevant replicability did not 

offer any threats to the study at the time and under the 
conditions of its instrumentation. 



ANOTHER SOURCE FOR HTTERACTIOH 

Interaction, or the possible effect of each cell on its neighboring 
cell or cells. In the design described herein Is rather high, over all, 
for this experimental study. One particular possibility not mentioned 
above that continues to disturb the investigators relates to the manner 
in which the individual test Items were selected. 

As described elsewhere In this report, the test items for each day 
accumulated throughout the five test day v/eek, and for each test day five 
items v/ere randomly selected for that particular day»s experimental treatment. 
Let the reader again refer to a chart: 





. MOM. 


TUES. 


l.^ED. 


THURS. 
... . 


FRI.. _ 


NB/TEST 








1 






ITEMS 


6 


to 10 


6 to 10 


6 to 10 1 


6 to 10 


6 to 10 


ADDED 








1 






prWIois* 






"*^XiTT-T6‘' 


“ AiT Mon7X 


All Mon.-i* 


Al 1 Hon. -1- 


TEST ITEf-iS 




Hone 


Items from 


Tues. 


Tues,-K/cd. 


Tues.+ V/ed.-l- 


ADDED 


L ^ 




Monday. 


items. 


items. 


Thurs. items. 


TEST “iTCMS 














RAT^DOMLY 














SELECTED FOR 


X 


5 

. 


5 


5 


5 


5 


TOTAL: 25 items selected from 30 to 


50 submitted weekly. 
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During the second or third week o1 the study the researchers began to 
question some possible source for Invalidity posed by Interaction at this 
level. Control v/as attempted by random selection of all items as Indicated . 
but the Investigators feel that a tighter control Is desirobi- v.r zv." 
future experimental effort. 

SUMM^niZlMG ACCOROIMG TO C/^^-iP3ELL ATiD STAICEY*- 

INTERNAL SOURCES: 

History 

Maturation 

V Testing 
Instrumentation 
Regression 
Selection 

?-i- Mortality 

V Interaction of selection and maturation 

EXTERNAL SOURCES: 

Testing X Interaction 
?- Selection X Interaction 

Reactive arrangements 
-!- Multiple X Interaction 



‘^Ibld., p. 56. 





OTHER PROBLEMS IM THE STUDY 



It was to be expected that some students v/ould tend to study tov/ards 
a particular type of examination. In an effort to control this particular 
threat to validity. Inherent In the experimental treatment, the types of 
items and material emphasis was shifted throughout the study. 

Another threat to validity, that was anticipated in this study related 
to spontaneous improvement In scores resulting from students becoming test 
wise and experienced* Efforts to control this threat to validity included 
a gradual increase In Item difficulty as the study progressed. 

One problem not anticipated by the investigators was related to cribbing 
or cheating by a small number of the students. The evidence of these 
deceptive activities v/as discovered by the researchers upon Initiation 
of the statistical treatment on the data. All test and scoring calculations 
were routinely rediecked and corrected wherever discrepancies v/ere discovered, 
nevertheless this remains one of the major threats to the validity of the 
study; any future v/ork along these lines will demand more attention to 
this problem and more efforts to correct the Inadequacy. 

Several interruptions related to city-wide civil disturbances and 
intervening school activities prevailed and resulted In limited or restricted 
research activities for these dates thereby reducing available data to the 
study. On April 3rd the fifth and sixth period classes received no 
experimental treatment, and on April 29th the fifth period v/as again omitted 
from the testing procedure. 

Mo experimental treatment v/as carried out on the follov/ing dates: 



March 28, I96S 
March 29, I96G 
April 5, I960 
April 8, 1968 
April 12, 1968 
April 15, I96C 



Experimental subject losses related to student out-transfers during 
the course of this study amounted to six. 



Student absences totaled three hundred five with the following 
distribution anx)ng the classes: 

PERIOD ABSENCES 



First Period 72 
Second Period 55 
Third Period 68 
Fifth Period 49 
S I xth Per 1 od §1 

Total 305 



As indicated by the table on page 23 of this report, student subjects 
present and available for the experimental treatment during the seven weeks 
course of this study amounted to, by classes; 
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cuss PERIOD 



I'lUMBER OF STUDENTS TESTED 



First Period 


740 


Second Period 


786 


Tl'iird Period 


763 


Fifth Period 


60i 


Sixth Period 


583 


T-tal 


3,473 



Tine was a crucial factor in carrying out the experimental treatments 
of this study and the investigators feel that a complete school year should 
be devoted to any future data gathering activities of a related nature# 



0*niER rjECaiOlDATIOl'JS FOR IMPROVING THE STUDY 



In regard to cribbing or cheating on the test one alternative v/ould 
be for the researchers to score the test themselves— a rather time consuming 
activity. Another approach to solving the problem v/ould be to furnish 
preprinted multiple Item score cards and hand punchers. Tne students v/ould 
mark only the correct choice by punching the indicated mark for a selection. 
This approacti could be adapted to automated procedures of data processing 
and computer scoring and grading. Tliey could also take the examination 
In ink, allov/ing no erasure or changes. Still another approach v/ould be 
to furnish red Ink or pencil for ail scoring activities by the students. 
Another possibility v/ould be to recruit volunteer student assistants v/lvose 
sole responsi bi I ity v/ould be the grading of the papers. Tlie latter v/ouid 
probably be the method of choice at this time. Tie investigators realize 
that the above measures are no panacea but do feel that they v/ould effect 
some reduction In the incidence of cheating on the test and therefore 
enhance test validity and reliability. 



69 



zoTi 73c::lm o m :2 wmcH 



STATISTICAL AIIALYS IS— RESULTS AND CONCLUS 1 01^!S 



The statistical analysis design chosen for this research report 
v/as intended to render a day by day analysis of variability for a day 
versus day comparison over each of five days by five days horizontally and 

very cal ly, determining F values for each cell as Indicated by the following 
row/column table'. 



NONDAY TUESDAY V.^DNESDAY THURSDAY FRIDAY 





1 

i ion day 


9 

Monday 


j 

Monday 


Monday 




versus 


versus 


versus 


versus 




Tuesday 


V/ednesday 


Thursday 


Friday 




r 


F 


F 


F 













Tuesday 




Tuesday 


Tuesday 


Tuesday 


versus 




versus 


versus 


versus 


Nonday 


1 

i 


1 Wednesday 


Thursday 


Friday 


F 


! 

i 

1 


1 F 

\ 


F 


F 


.. ... 


1 

« .* .. -w *1 

i 


t ^ 

i 






V/ednesday 


1 

V/ednesday ! 


t 


l/ednesday 


V/ednesday 


versus 


versus t 
Tuesday } 


versus 


versus 


Monday 


Thursday 


Friday 


F 


^ \ 

i 


‘ ! 


F 


F 




1 


i 






Tliursday 


f 

Thursday 


1 

Thursday 




Thursday 


versus 


versus 


versus 




versus 


Monday 


Tuesday 


V/ednesday 




Friday 


F 


F 


F 




F 











r .... - *-*■ *-**^- ..t 


Friday 


Friday 


Friday 


Friday 




versus 


versus 


versus 


versus 




Monday 


Tuesday 


l/ednesday 


Tliursday 




F 


F 


F 


F 










T ~ -r 1 y r>— m. .* 



This method utilized the F test v/lilch compares the variability v/lthin 
samples to the variability among tv/o or more saioples to determine the 
probability that the variance among samples is due to chance and not due to 
sampling from populations having different means. In other words, the 
techniques as used In this study v/ere designed to determine v/hether the 
groups diverged sufficiently to be considered as no longer representative 
of the same pupulation. The values of F v/ere determined by the use of 
appropriate tables and reported accordingly in charts and tables Included 
in this report. 



ERIC 
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More specifically^ Monday v/as subjected to an analysis of variance 
comparison with Tuesday and an F ratio determined and compared \/lth F 
table values. Monday v/as then compared v/lth V/edneSday and so on through 
Friday, Each of the days in the v/eek v/ere similarly compared with every 
other day in the v/eek. tlie computed F values v/ere then compared with table 
F values at the one percent (.01) and the five percent (.05) levels of 
confidence to make the necessary determinations regarding significance of 
the data obtained. 



FURTHER /u'JALYSIS V/ITH T1-!E ai/^TS 



As indicated by suntflary chart number one the v/eekly v/eek-day variations 
held to a rather similar pattern of fluctuation with the one exception of 
Friday (the short blade line). Friday, however, represented a very short 
term situation as regards the experimental treatment since there were only 
four Friday’s that received the experimental treatment during the entire 
seven weeks of the study, nevertheless, there v/as no indication of any 
significant differences betv/een any tv/o given days, according to the 
analysis of variance done on the data obtained during the seven weeks period. 

The bar graph charts indicate the standing of the classes based on the 
over ail means, TJiere are daily charts plus a summary chart for all five 
v/eek days. 

Tlie sum of the means charts indicate a slight superiority for the 
fifth period class v;ith a grand mean of 3.57 and the sixth period group 
follov/s closely with a grand mean of 3.36. Tliese performances v/ere 
expected by the investigators. 

TTie expected low In the first period, however, did not occur. Tills 
dubious honor was taken by the third period class with a 2.93, while the 
first period scored a 3.06. 

The expectations mentioned above v/ere based on experience and 
classroom records recorded by Mr. ’./elsh and L. Joyner (as a student teacher) 
prior to the Initiation of any experimental treatment related to this research 
effort. 

The performance standing for any class is a chance occurance in the 
respect that no ability grouping is attempted at Bellevue Junior High School. 
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NEAlvlIUG CF THE AJIALYSIS 



The Investigators evaluated the results of the experiment by subjecting 
the data to an analysis of variance v/herein the betv/een~>samplc variance v/as 
compared v/lth the v/lthIn-'Sample variance In an mtNA table. Tlie betv/ecn 
sample variance Is a measure of the treatment effect contaminated by error 
and Is obtained v/hen only the average means being compared are used as the 
data. The v/lth in sample variance Is a measure or estimate of the error 
v/hich Is responsible for the above contamination and Is an over all variance 
computed for all the data being compared. The v/lth In variance also indicates 
the size of the errors, v/hIch In being randomly distributed over the tv/o 
samples, may actually have produced the betv/een-sarnple variance. The mean 
square ratio of one variance Is compared v/ith the other to obtain a 
computed F v/hIch Is then analyzed according to predetermined table values 
for this comparison.'^ 

As indicated by the series of AI^JOVA tables Included In this report, 
and other tables and charts detailing the statistical findings — no significant 
difference in the means v/as found at the confidence levels nov/ Indicated. 

Tlie Investigators therefore failed to reject null at these levels for any 
data included and analyzed In this report. It Is therefore concluded that 
NO SIGNinC/W RELATIOi'iSMIP EXIST BET. TEEN P/vRTICULAR DAY OF THE \£EK 

AND STUDENT ACHIEVEieiT AS PEASURED BY DAILY TEST /MINISTRATION. 



PROBLeiS WITH THE AI3ALYSIS 

According to Doctors Tliomsen and Fortune, the analysis as reported 
herein Is subject to a geometric pile up of probability errors, horizontally 
by days, and "stacking'* of this error, vertically by v/eeks.*^^ 

Tills major problem as confronted In the analysis of the data obtained 
In the study related to, and v/as primarily precipitated by, the Incomplete 
data cells In the analysis of variance design. Tills element occuring In 
the study precluded the simple analysis of variance approach as permitted 
v/hen all cells are filled. 

Tlie statistical design, basically an analysis of variance v/lth 
Incomplete blocks by days and nested Intervals by v/eeks, v/as subjected to 
a modification vtIiIcIi permitted the Inclusion and comparison of only those 
days on v/hIch experimental treatment v/as carried out and data v/as obtained. 
Since Doctors Tiomsen and Fortune, as mentioned above, suggested that this 
is primarily an approximation and therefore vulnerable to a plle-up of 
probability errors as stated, the determined ratios might be defined as 
F * rather than F. Tliese workers suggest that any future analysis of 
these data Include a chi squares or Latin squares analysis and an AIWA 
based on the Incomplete block, nested Interval techniques as described 
by Scheffli 

Tills writer plans to submit such an analysis as a suppternentarv inclusion 
to this report, If time permits. 



•"^Or. Donald RIckhart Tliotnsen, Associate Professor of Education, Memphis 
State University, Memphis, Tennessee and Or. Jim Carleton Fortune, Assistant 
Professor of Education also at Memphis State University. 

•5ilenry Scheffi , The Analysis of Variance, Mew York: John l/lley & 

Sons, Inc., pp. 147-OG. *f9!59™ 
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A brie*? look at the enclosed charts and tables v/l 1 1 reveal that these 
Invest I fjators failed to reject null at the one percent (.01), or the five 
percent (.05), confidence levels *?or all comparisons considered. 

Obviously the apparent treatment effects v/ere small v/hen compared 
v/ith the errors v/(;ich could have produced them. Since it is a fundamental 
principle In the analysis of variance tiiat the greater the variability 
among the samples In the study, the larger ulll be the errors to vnich the 
experimental comparison is liable and the more suspect v/l 1 1 be the rbnerved 
differences betv/een the samples, then it must follov/, therefore, XUcii chance 
alone could have produced differences as large as, or larger than, *the 
differences observed In this study. It must be cor.cluded then that the 
data obtained and analyzed for *the purposes of “this study failed to reveal 
any significant relationships, or effects, related to the particular v/eek 
day of test administration on ninth grade student achievement as measured 
by daily testing over a seven v/eek period at Bellevue Junior High School. 



RECat'EHOATiaJS FOR FUTURE STUDIES I il Til IS /\REA 



These v/orUers are of the opinion that more investigation should be 
conducted In the area of tiiis study. Tliey feel that the results arc 
Inconclusive and studies are recommended vyliich v/ould obtain more data 
under conditions of tighter controls. In this regard the follov/Ing recorji- 
mended which v/ould obtain more data under conditions of tighter controls. 

In this regard the follov/ing rcconriicndat i ons for future studies are set 
forth : 

1. A minimum period of one full school year should be devoted to 
the experimental treatment and data gathering activities. 

Tlie seven v/eeUs period of this study v/as too susceptible to class 
time lost and student absent ratesj a longer period of ti:.:r v/ould 
insure more complete data for analysis. 

2. Some effort should be made to randomize the samples for future 
study. This v/ould permit a period by period evaluation and 
further reduce many Internal threats. 

3. If at all possible some standardized testing should be available 
for the selection of test items. Tliese Investigators v/ere con- 
fronted v/lth situations that may have reflected item or test 
difficulty rather than a v/eek day inf lucncc— more effort needs 
to be made to separate these two effects. 

4. Increased effort is needed to standardize the technique of the 
experimental treatment as v/ell as the testing atmosphere. There 
is some question in the minds of the researchers regarding the 
conscientiousness of student attitudes tov/ards these testing 
situations. 

5. These Investigators also feel that consideration should be given 
to separation of record grading and data recording techniques 

as v/ell as discontinuance of the procedure for recording student 
names on each test. It Is felt that this v/ould help to further 
reduce test anxiety and possibly lessen the incidence of 
cribbing and cheating on the test by the students. 

6. If politically feasible, acquisition of Individual student l.Q. 
and previous achievement scores is to be desired in future 
efforts. 

7. Another interesting prospect for future determinations by dally 
testing Is related to applications of the experimental treatment 
to the evaluation of achievement by student subjects in elective 
areas rather than required courses. 

8. Tiie researchers also feel that some effort to obtain a study- 
habits-prof I le on the participating student subjects would 
provide some interesting material relevant to the study. 



Related to number one above — effort should be made to 
include simultaneous rep! icabi I Ity at several randomly selected 
schools in the city as well as over the suburbal and rural 
areas of V/est Tennessee, 

It is also reeonwended that any future studies in this area 
be designed to incorporate electronic data processing equipment 
and technique Into the statistical analysis. 

Related to ten above — computer based testing and grading 
should be used v/lien and where possible. 



SUISI/W 



In sunimary tlicn, these workers are of the opinion that the 
data obtained, analyzed, evaluated and presented in this report arc not 
conclusive and the study v/as confronted by too many variables and tji/^ats 
to validity which the researchers failed to adequately control. It is 
also the fcellmj of these investigators, however, that there has been 
established an adequate basis and indication for more extensive and 
precisely controlled work in this area. 



PROJECT ON 



TEST DEVELOPMENT 
January 3^ 1968 
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Theresa Browning 
Lynn Wells 



IimiODUCTION! 

All of the members of the Undergraduate Research Training Prograni at 
Men5>his State thiiversity were assigned the project of developing a test 
and checking its reliability and validity; our team, con^josed of Theresa 
Browning, Lucy Reap, and lynn Wells, wanted to work with something that 
we thought might be useful to us as future teachers. While preparing for 
our second semester research project, all of us had become interested in 
attitudinal scales and measurements. Since two of us are future mathematics 
teachers, we selected algebra as the school subject area to test and to use 
in correlation with our attitude scale. 

With the aid of algebra textbooks checked out from the Men^Jhis 
State Curriculum Lab, we developed a comprehensive algebra test. The attitude 
scale was designed in the form of Likert’s attitudinal scales. Our attitude 
scale comprised six questions, three of which were distractors, with 
alternating favorable and unfavorable response choices. 

We received permission from the principal of one of the city schools 
to administer our tests in his school; and, we enlisted the cooperation 
of a first-year algebra teacher, idio offered us the students in her three 
classes as subjects. 

PILO T ,1EST: 

The pilot test was administered to the twenty-two students of the 
9 j 45 a.m. class. We ran an item analysis on the fifteen items of the 
algebra test; results are shown on Table I. 

The algebra test was divided into two parts by flipping a coin. 

The first part included items 2, 3b, 4> 5, 6, 7> 11, 155 second part 

included items 1, 3a > 9, 10, 12, 13, and 14. Using the split-half method 

of determining reliability, the reliability coefficient was established as 
.51B347. (See Table II.) 

This study’s main point of interest was the determination of the 
effect that knowledge of results has in the development of the student’s 
attitude toward the test itself. For this reason, the test was administered 
in two different ways. One half of the class received immediate feedback 
as to each student’s score on the test. This portion of th« class was 
given the answers to the algebi*a test, written on the attitude scale. The 
othor portion of the class did not receive answers prior to responding to 
the attitude scale* The Pearson formula was used in the determination of 
the correlation between the algebra test and the attitude scale given to 
both groups. The correlation coefficients were as following: Immediate 

knowledge of the tost results and the score on the attitude scale, -.612; 
no knowledge of tne test results and the score on the attitude scale, 

,0154. Results are shown on Tables III a and III b. 

PINAL TESTS: 

From the results of the pilot test and suggestions by the 
supervising teacher, we increased the difficulty of the algebra test. 

The revised test was administered to two classes, an B:45 a.m, class and 
a 2:15 p.m. class. 
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An item anal^rsis of tho fourboon items was made on the KK)rnin?j: class 
of t\^ent7-niiie students; results are shoini on Table IV a. 

flipping a coin, \iq divided tho final test into tiio parts. The 
first part consisted of items 3a, 3b, 4, 5^ C, 9, H, 12, 14j the second 
part coirta^^ it^ 1, 2, 6, ?, 10, 13. Bf?- use of the split-h?lf method, 
the reliability coefficient of tlie test as given to the morning class v/as 
.7301. (See Table V.) 

The students in the morning class did not laiow the correct answers 
to the algebra test before talcing the attitude scale. Tlie Spearman 
Corx’elation Coefficient between the algebra test and the attituide scale 
for this class was -.321. (See Table ^1.) 

Tlio results of the item anal 3 ?“sis made on the afternoon class of 
twent 3 ^ students are shown on Table VI b. 

using the split-half method and the same raiadom maimer of item 
division, the reliabilit 3 »- coefficient \ias found to be .514^. (See Table VII.) 

Before baling the attitude scale, the students in the afternoon class 
•wore given the correct ansifers. For this class, the Spearman Correlation 
Coefficient ms -.430. (See Table HU.) 

In combining the results of the moving class and the afternoon class, 
the over-all reliabilitj'- of the tests was .6633. (See Table EC). 



COITCLUSIOII: 

^bhough ICerlinger states 'High reliability^ is no guarantee of good 
scientific results Downie says that on an ordinary’' class room 

tost a reliability 'of .50 mi^it be typical." Our results exceed Dovmie’s 
e3q>ectations of a classroom test. 

On the final testing, the correlation coefficients show that tho 
students "vAio made the hipest scores on the algebra tests rated the test 
relatively easy on the attitude scale. This ims true for both classes 
talcing the test — the one that had !nowiedge of the test scores prior to 
talding the attitude test and the one that had no Inowledge of best performance 
before responding to the attitude scale. Tliis would seem to indicate that 
immediate feedbacic of test results has no bearing in the studen-iis attitude 
toTrfard 'the test itself. However, tho correlations obtained on the pilot 
test n/orc slightly different than those obtained on the f- *j. tests. This 
could be due to the change ii testing conditions. During tho final tests, 
the class winich ms given tho ansv/ors to the algebra test was completelyr 
separated fx’om those ifere not given the correct answers pi’ior to 
responding to the attitude scale. Therefore, further studies in tinis 
area vrould be interesting in the light of the contrasting results of 
the pilot test and the final tests. 



TABLE I 



PILOT TEST 



ITEt-i AilALISIS 



£ORn^T ^SPpNS^^ 



1. 


17 


2. 


19 


3. (a) 


16 


Co) 


15 


4. 


10 


5. 


12 


6. 


10 


7. 


22 


D. 


22 


9. 


13 


10. 


0 


11. 


0 ^. 

O 


12. 


2 


13. 


10 


14. 


19 


15. 


21 



pcpi^CT P^PONSES. 

5 

3 

6 

7 

4 
10 

4 

0 

0 

9 

22 

14 

20 

4 

3 

1 
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TABLE II 



RELIABILITY OF PILOT TEST 



"'ll- 



X 

7 

6 

6 

4 

5 

7 

8 
8 

7 

6 
7 
6 

4 

5 
5 
7 
7 
5 
5 

5 

6 
6 



Y I 
T-** 



4 
6 

5 
4 

3 
7 

4 

5 

6 

5 

6 

3 

4 
3 

5 
5 
5 

5 
3 

6 
6 
6 



r 1 
XI 



= P 



P 



X 3" 



i.132 £106 



X-Y 


X2 


y2 


28 


49 


16 


36 


36 


36 


30 


36 


25 


16 


16 


16 


15 


25 


9 


49 


49 


49 


32 


64. 


16 


40 


64 


25 


42 


49 


36 


30 


36 


25 


42 


49 


36 


18 


36 


9 


16 


16 


16 


15 


25 


9 


25 


25 


25 


35 


49 


25 


35 


49 


25 


25 


25 


25 


15 


25 


9 


30 


25 


36 


36 


36 


36 


41 




-16 


£646 


£820 


£540 



^•'7 * 



iS_2l 

U 

~J^1 



X 



7T 



N 



II 



Y 



il 



P == /132\/106\~ 29.3636 - (6) (4.S181) = 29.3636 - 28.9086 = .4550 



2Ek2 Viii2 \ 

22 \ 22)(22j 



cfx 1 820 •• lg2\^ =J 37.2727 - 36 -/1.2727 =1.128 

V 22 v22y 

I SbQ.^( 

V 22 V 22y =^ 24.5454 - 23.2141 =.; 1.3313 = 1.153 

dx ^ ^ (1.128) (1.153) 1.300584 

.349843 



JL^ == >45ii4 

1.300584 

C^cOy 



^ X .349^3_ ^ ^6^9686 
H- “.349843 1 . 3 U 9 m 




518347 
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TABLE III a 



ALGEBRA 

SCORE ATTITUDE 



X 


r X-35= X 


Y-Y = 3 


— 


~ ^ ♦ 




11.5 


4.74 1.68 


-2.54 


7.5 


10.98 -2.32 


3.70 


8.0 


15.00 -1.82 


8.72 


11.5 


5.49 1.68 


-1.79 


10.5 


7.26 .68 


.02 


9.0 


4.50 - .82 


-2. 78 


7.0 


7.74 -2.82 


.48 


11.0 


5.40 1.18 


-1.88 


9.5 


10.25 - .32 


2.97 


10.0 


3.75 .18 


-3.53 


12.5 


JuPl , 2.68 


-2.27^ 


1.10S.0 


?80.12 




X * 9. 


82 T - 7.28 




SDjj 


(32.1364 » ^.9215 


SD^ « 


*137.2936 « ) 12.4812 - 


y 


>J 11 i 




r * 


-40.6478 




11(1.71) (3.53) 




r ■ 


-40.6478 

66.3993 




r » 


-.612 





x-y 






- 4.2672 


Z .& S2h 


6.4516 


- 8.5840 


5.3824 


13.6900 


-15.8740 


3.3124 


76.0384 


- 3.0072 


2.8224 


3.2041 


- .0136 


.4624 


.0004 


2.2796 


.6724 


7.7284 


- 1.2972 


7.9524 


.2116 


- 2.2184 


1.3924 


3.5344 


- .9504 


.1024 


8.8209 


- .6354 


.0324 


12.4609 


- 6.^6 


7.1824 


5.1529 


1.-40.6478 


^32.1364 


^137.2936 



1.71 

3.53 
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TABLE III b 



AL6EBBA 



Score 


Attitude 


X-X * X Y-Y » y X • y 


x2 


y2 


10.0 


4.98 


-.59 


49 .2891 


100 


24.8004 


. 10.5 


7.23 


-.09 1, 


76 -.1584 


110.25 


52.2729 


13.0 


6.24 


2.41 


77 1.8557 


169 


38.9376 


12.5 


4.50 


1.91 


97 -1.8527 


156.25 


59.9076 


12.5 


7.74 


1.91 2. 


27 4.3357 


156.25 


59.9076 


12.0 


5.49 


1.41 


.02 .0282 


144 


30.1401 


7.5 


3.00 


-3.09 -2. 


47 7.6323 


56.25 


9.0000 


9.0 


3.51 


-1.59 -1.96 3.U64 


81 


12.3201 


11.01 


4.74 


.41 -. 


73 -.2993 


121 


22.4676 


7.5 


6.99 


-3.09 1.52 -4.6968 


56.25 


48.8601 


11.0 


5.76 


.41 


29 .1189 


121.00 


33.1776 


1116.5 


160.18 




ClO.3691 


<1271.25 


(?52.1340 


SDx - I 


1 1271.25 


« J115.5681 


- 10.75 








i U 


N 










[352.1340 
1 U 


- 132.0121 


- 5.66 







r « 10.3691 

11(10.75) (5.66) 

r « 10.3691 

669.2950 

r » .0154 






TABLE IV a 



Item Analysis 



A*M* Class 



o 

ERIC 



Correct Responses 



Incorrect Responses 



1. 


15 


14 


2. 


22 


7 


3. 


(a) 25 (b) 12 


(a) 14 (b) 17 


4. 


23 


6 


5. 


10 


19 


6. 


15 


14 


7. 


19 


10 


8. 


0 


29 


9. 


5 


24 


10. 


6 


23 


11. 


8 


21 


12. 


10 


19 


13. 


11 


18 


14. 


6 


23 



TABLE IV b 



Item Analysis P.H. Class 



Correct Responses 

1. 14 

2. 13 

3. * (a) 15 (b) 13 

4. 20 

5. 7 

6 . 11 

7. 14 

a. 2 

9. 0 

10. 8 

11 . 2 

12. 6 

13. 7 

14. 4 



Incorrect Responses 



(a) 



6 

7 

5 
0 

13 
9 

6 

18 

20 

12 

18 

14 
13 
16 



(b) 7 
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TABLE V 



Reliability A.M. Class 



Totals 




P 

P 

P 



S£S!l 

H vriT/VN / 





sdl 



> N 





- 1.39 



« i¥f 



(aOO -/96\2 
N 29 \29/ 

(Jy* 1-68 

^ “ P (correla- 

<T5c ^ tion) 

r - 1.3424 

(1.39) (1.68) 

r - .5749 r»t 1 1 

III 



' " 2rij, 

III 

1 + ri 1 

in 

r - 2 (.5749) 

1 + .5749 



r 



7301 (reliability; 



1ABI£ VI 



Correlation A,H« Class 



A 

All* Test 


X 

Att. Test 


Rank X 


Rank Y 


Diff. 




3.5 


3,50 


25.0 


4.0 


21.0 


441.00 


5.0 


2.67 


16;0 


15.0 


1.0 


1.00 


10«0 


1.58 


2.0 


28.0 


26.0 


676.00 


5«0 


2.58 


16;0 


16.5 


.5 


272.25 


3.5 


2.58 


25.0 


16.5 


8.5 


272,25 


6.5 


3.58 


10;5 


3.0 


7.5 


56.25 


13.0 


1.42 


lib 


29.0 


28.0 


784.00 


4.5 


3.00 


20.5 


9.0 


11.5 


132.25 


5.5 


3.00 


12i5 


9.0 


3.5 


12.25 


.5 


3.17 


25i0 


7.0 


22.0 


484.00 


4.5 


2.83 


20i5 


11.0 


9.5 


90.25 


5.0 


2.33 


16i0 


20.0 


4.0 


16.00 


2.5 


2.50 


27;5 


18.0 


9.5 


90.25 


3.5 


3.00 


25i0 


9.0 


16.0 


256.00 


7.5 


2.33 


5.5 


20.0 


14.5 


210.25 


6.5 


2.75 


10;5 


13.0 


2.5 


6;25 


4.5 


1.67 


20i5 


27.0 


6.5 


42.25 


7.0 


2.25 


8.0 


22.0 


14.0 


196.00 


7.0 


3.67 


8.0 


2.0 


6.0 


36.00 


5.0 


2.75 


16;0 


13.0 


3.0 


9i00 


7.0 


3,33 


8i0 


6.0 


2.0 


4;00 


2.5 


4.00 


27.5 


l.O 


26.5 


702,25 


4.0 


2.06 


23i0 


24.0 


1.0 


1.00 


9.5 


2.33 


3*0 


20.0 


17.0 


289;00 


4.5 


1.83 


20;5 


26.0 


5.5 


30.25 


9.0 


3.42 


4i0 


5.0 


1.0 


l.OO 


7.5 


2.75 


5.5 


13.0 


7.5 


56.25 


5.5 


2.08 


12;5 


24.0 


11.5 


132;25 


5.0 


2.08 


16.0 


24.0 


8.0 


G4i00 


al 










5363.50 



Note ! Tills class did 
not know the correct 
answers on the algebra 
test before talcing the 
attitude test; 



rho “I - 6 

rho » 1 - 6f5363^50) 
2H29'^i'> 

rho * •*•321 



Interpretation ! 
Students who oiade hi^ 
on the algebra test 
rated the test as 
relatively easy; 



87 



Totals 



o 

ERIC 



TABLE Vil 



Reliability P.H. Class 



Scores Oil 
1st Part 
ox Test 

X 


Scores On 
2nd Part 
of Test 

y - 


xy 






5 


6 


30 


25 


, 

36 


5 


5 


25 


25 


25 


4 


5 


20 


16 


25 


4 


4 


16 


16 


16 


3 


1 


3 


9 


1 


3 


3 


9 


9 


9 


2 


3 


6 


4 


9 


1 


3 


3 


1 


9 


4 


5 


20 


16 


25 


2 


4 


8 


4 


16 


5 


2 


10 


25 


4 


1 


4 


4 


1 


16 


3 


3 


9 


9 


9 


4 


3 


12 


16 


9 


4 


4 


16 


16 


16 


3 


4 


12 


9 


16 


4 


5 


20 


16 


25 


5 


3 


15 


25 


9 


2 


1 


2 


4 


1 


3 


1 


3 


9 


1 


67 


69 


243 


255 


277 



P 

N 








CM 

1 

1 




I 277 - /69\2 
1 20 \20/ 


Cy - 


1.39 


r « 


P 


r « 


.5925 


(1.23) (1.39) 


r « 


.3465 (correlation) 


r ■ 


2 1 
7rr 


r » 


2(.3465) 

1.3465 


r « 


.5146 (reliability) 
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TABLE VIII 



Correlation P.H. Class 



X 



Alg. Test 



Att 



10.0 

9.5 

8.5 

7.0 

4.0 

5.0 

4.0 

3.5 

8.0 

5.0 

7.0 

5.0 

6.0 

7.0 

7.5 

7.0 

8.0 

7.5 
3.0 

4.5 



Y 

. Test 


Rank X 


Rank Y 


Diff, 




1.90 


1.0 


20.0 


19.0 


361.00 


3.25 


2.0 


7.5 


5.5 


30.25 


1.92 


3.0 


19.0 


16.0 


256.00 


3.67 


9.5 


5.0 


4.5 


20.25 


2.33 


17.5 


15.5 


2.0 


4.00 


2.83 


14.0 


11.5 


2.5 


6.25 


2.83 


17.5 


11.5 


6.0 


36.00 


4.17 


19.0 


1 


18.0 


324.00 


2.00 


4.5 


17.5 


13.0 


169.00 


3.42 


14.0 


6.0 


8.0 


64.00 


3.83 


9.5 


3.5 


6.0 


36.00 


3.25 


14.0 


7.5 


6.5 


42.25 


4.08 


12.0 


2.0 


10.0 


100.00 


2.00 


9.5 


17.5 


8.0 


64.00 


2.50 


6.5 


14.0 


7.5 


56.25 


2.92 


9.5 


10.0 


0.5 


.25 


2.33 


4.5 


15.5 


11.0 


121.00 


3.08 


6.5 


9.0 


2.5 


6.25 


2.75 


20.0 


13.0 


7.0 


49.00 


3.83 


16.0 


3.5 


12.5 


156.25 



1902.00 



Note ; This class did 
know the correct answers 
on the algebra test 
before taking the 
attitude test. 



tho - 1 - 

rho « 1 - 6(1902.00) 
20 ( 202 ^- 1 ) 

rho » -.430 



Interpretation; Students 
who made high on the 
algebra test rated the 
teat as comparatively 
easy. 



Total 



TABLE IX 



Reliability - Combined Classes 



Cx » 84 + 67 » 151 
« 96 + 69 • 165 
C^XY - 317 + 243 - 560 



S. 

N 

560 

49 



- ( U \) 

\ NAN/ 



151 165 
49 49 



Cx^ « 300 + 255 * 555 
^Y*^ - 400 + 277 •= 677 
N - 29 + 20 « 49 



1.0516 






}r^ ■ fey 

\1 N \n7 

I555 - /151)2 
V 49 VW 



49 
« 1.35 



<5y 

dy 

Of 




1.57 



r - P 

r » 1.0516 

(1.35)(1.57!> 

r » .4962 (corcelation) 



r ■ 2r 

1 + r 

r « .9924 

1 + .4962 

r - .6633 (reliability) 
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NAME DATE 



PARI 1 » 

Simplify: 

(1) ^ _ 2X + + 6 - 2x^ + - X - 1 (2) 20xj 

(3) If X « -5 and y • -5, find the value of: 

a. x^y b. -x3 

Solve: 

(4) A ■ Mbfc) If b • 8, c » 18, h ■ 14. (5) C » 5 (F-32) for F when C«10C 

2 9 

(6) p + .12p • 280 (7) 1.7x + 604 « 2.3x + 148 



PART II . 

(8) Multiply the produce of c + 5 and c « 8 by c •* 2. 

(9) Multiply a^ - 6a + 9 by a - 1. 

(10) Divide - x2 by Y - X. (11) Solve for x and 3x + y - 5 

2 - y « 9 

(12) On Monday, the temperature was 20® above zero; on Tuesday, the 
t^perature dropped to 7® below zero; on Wednesday, the temperature was 
6® above zero. What was the total change In temperature in degrees 
over the three-day period? 

(13) The sum of two numbers is 39. Two times the smaller nuBd>er plus two 
equals one half the larger nuodier. What are the two numbers? 

(14) A man has $2.00 in nickels and dimes. One half the number of nickels . . 
times six divided by two is your number of dimes. How many nickels and 
dimes does he have? 

ANSWERS: 



1 . 

2 . 

3. 

4. 

5. 

6 . 

7. 

o 

ERIC 



8 . 

9. 

10 . 

11 . 

12 , 

13. 

14. 



91 



NAME 



DATE 





Please answer each of these six questions in the following manner 
EXAMPLE: Today the weather is 



Cold 



X 






Still 



X Windy 



If the temperature is in the high 50 's (approximately 
teiq)erature) , put an X in the third blank (see above), 
very windy, put an X in the fifth blank. 



an "average” 
If it is 



Please be Jjonest in answering these questions. We want each Individual’s 



1 . 



2 . 



3. 



4 . 



5. 



6 . 



I would rate Algebra as: 
Easy 


Difficult 


Complex 


Simple 


Clear 


Confusins 


Vague “ 


Well’-explained 


The problems on this test were: 
Easy 


Difficult 


Complex 


Simple 


Clear 


Confusing 


Vague 


Well-explained 


Part I was: 
Easy 


Difficult 


Complex 


Simple 


Clear 


Confusing 


Vague 


Weil— explained 


Part II was: 
Easy 


Difficult 


Complex "* 


Simple 


Clear 


Confusing 


Vague 


Well— explained 


In general, the homework assignments for 
Easy 


this class have been: 
Difficult 


Complex 


Simple 


Clear ' ^ ““ 


Confusing 


Vague 


Well— exnlAinpfi 


n»e explanations by the teacher in class have been; 

Difficult 


Complex 


Simple 


Clear 


Confusing 


Vague 


Well-explained 
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NAME date 

PART I. 



(1) - 2x + 6 - - 1 




(2) 20x2 

-5x 


(3) If X » -5 and y * -5, find the value of: 
a. xy^ b. -x^ 




Solve: 






(4) A - h(b + b') If b • 8. b' « 18, 
2 


h • 14. 


(5) C * 5 (F-32) for F when 
9 C « 100. 


(6) p + .12p • 280 




(7) 1.3x + 604 « 2.7x + 142 


PART II. 






(8) Multiply c + 5 by c - 8 




(9) Multiply - 6a + 9 

by a - 1. 


(10) Divide - 6x + 9 by x - 3. 




(11) Divide x^ - y^ by x - 


(12) Solve for x and 2} 3x + y « 5 

X - y « 1 






(13) What is the difference in degrees between 
zero? 


6° above zero and 18® below 


(14) The sum of two numbers is 40 and the larger exceeds three times the 
smaller by 4. Vftiat are the numbers? 


(15) A has 2 more nickels than dimes. He has $1.15 in all. How many 

coins of eadi kind has he? 


ANSWERS: 






1. 


8. 




2. 


9. 




3. 


10. 




4. 


11. 




5. 


12. 




6. 


13. 




7. 


14. 





15. 
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THE EFFECT OF THE PARTICULAR V/EEK OAY OF TEST 
AOMir:lSTRATION m NIM1H GRADE S7UDE^r^ 
ACHIEVEICfJT AS lE/^SURED BY 
DAILY TESTING* 



SUPPLO€NT i^JUMBER OfC 
TO THE REPORT 

* Further Analysis 



SUBMITTED BY: 
LEA V/. JOYNER 



JUKE 1968 



iimooucTioi: to the supples laiT 



:osr£:x<^j^Y 



The reader ciesirin:* to further inform hir.iself rcfiardinr: the 
specific techniques ov the modern approacS'. to Analysis of Variance 
v/ill find! 

1. i]o sIiorta:jG of materials on the subject v/ritten for the 

. more mathematically sopSiist Seated. Scheffe and Ga^s are 

tv/o sources ijicludsd in the bibliography to tliis report, 

2. Materials written for the person without a fairly 
extensive background in mathmatics are not quite so 
prevalent nor easy to come by. 

This writer considers himself to be in the latter category 
and v/as hard pressed for published information that permitted 
the necessary understanding v/ithout seeking a higher level or 
professional interpretation of the material. This opportunity 
is taken to suggest, therefore, that one of the major obstacles 
to acquiring more qua! i ty research in the field of education 
might well be related to some aspect of this particular problem. 

It is the opinion of this writer thst much of the material could 
be simplified in both the explanation and In the examples of 
usage and demonstrated applications. There Is mucli need for some 
effort to produce MORE STRAIGHTFORWARD, SIMPLIFIED /^l!D TO TOE 
POlirr statistical materials that would allow persons with other- 
wise acceptable training and backgrounds to conduct adequate 
analysis on data, competently obtained in v/ell designed research 
studies. To say that every educational researcher must be a 
mathematics major is analogous to saying that every competent 
housekeeper and cook should also be a graduate economist and 
chemist in order to adequately interpret the household budget 
and the family cookbook. 

Tiie feeling of this v/riter is that qualified mathematicians 
could, and should, produce some materials along the lines of 
the Monarch Series or the Barnes and Mobles Series.^ Such 
materials should be adequate and sufficiently detailed in content 
and clarified in explanation for the ••nonmathematical** researcher to 
use as a necessary tool for more complete and reliable analysis 
of data.^ 

^einhard Her ink, Col lege Leve l Stat istics. New Yorks 
Monarch Press, Inc., I96SV Herbert Ark In Vnd Raymond R. Colton, 

St at i St i c_a I Methods^ Hew York: Barnes & Noble, Inc. 1967. 

2 

Jbld . There is a current publication by Monarch Press with 
a too brief discussion that would be ideal if expanded to cover all 
areas of tv/o way, three way, and four v/ay Analysis of Variation 
and Analysis of Covariation. 



o 
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DEFINITIOMS 



For purposes of this study and the included evaluation 

of data analysis the follov/ing definitions and/or symbols will 
be used: 

1. N = The number of items In the situation. 

2. R - The number of Items in the study. 

3* -^-= Tile Sum of. 

^ = Tiie GRAliD SUM. 



5. X -= SCORE(s). 

f 

6. X = Tiie ARITHMETIC l-EAH of scores. 

7. ^ = The ARITHIvETIC GRAND ^EAf^! of al I scores (also GM). 

8. j = Mathematical subnotationai reference to davs that 

varied as: I, 2, 3, 4, 5. 

9. j = Mathematical subnotationai reference to classes 

that varies as: I, 2 , 3, 4 , 5. 

10. k = Mathematical subnotationai reference to v/eeks that 
varied as: I, 2, 3, 4, 5, 6, 7. 

II.. = The NULL Hypothesis. 

12. AIWA = Analysis of VARIANCE. 

1 3 . AMOCCA'A = Ana I y s i s of COVAR I AtCE . 



o 

ERIC 



14. SS - SUMS of the SQUARES obtained by: ^ (X - X)^ = SS. 

15. OF = DEGREES FREEDOM — Hisually obtained by N— I or 

a related combination of the situational M-l. 

16. For purposes of this study SIG NI FIC A{n 1T DIFFERENCE OR 
^JPj'Urj.PAjjT VAR.I AT I ON v/i 1 1 be determined by the 
variance ratio test. 



J7.. Tlie WjRlAJXE RAT IO OR F TEST is often referred to as 
Snedecor^s F test, since Snedecor computed tables for 
the variance ratio distribution, and named the ratio 
F, in honor of R. A. Fisher. It depends mathematically 
on Fisher’s Z distribution, an extremely generai and 
fundamental distribution i4ilch includes the normal 
distribution, the chi square (x^) distribution, and 
Student’s T distribution as special cases. ^ 



M. J. Moroney, pacts From Fi gures . 
Pel lean Books, 1956, ^^33. 



Galtinvsre; 



M 



18. For purposes of this study the combined effects of 
tv/o or more variables as determined by AiWA and F 
comparison are considered to be, and are referred to 
as: Ji'n^ACT|Pil.S. 

19. Single variables judged to be possible sources of 

observable variations as determined by statistical 
analysis of F comparison are considered to be, and 
are referred to as: MAIM EFFECTS. 
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ABOUT THE AflOVA'" 



Moroney enthusiastically, and this v/rlter believes 
appropriately, terms the modern statistical methods for the 
analysis of variation and covariation: 



•Undoubtedly one of the most elegant, povferful, and 
useful techniques in modern statistical method...*’ 

This technique of analysis allov/s the researcher to reduce the 
total variation in the data under consideration to the 
particular elements of main effects and/or any combination of 
these effects that might possibly contribute to, or be asso- 
ciated v/ith, potential sources of variability, the Importance 
of v/Iiich the researcher may desire to study or assess. 

This technique is analogous to subjecting an organic 
biopsy to microscopic study and detailed analysis follov/ing 
a gross examination of the particular organ of concern. 

Tliese Investigators have tried to do much the same v/ith the 
data obtained in the study. 



They first reported findings based on a more superficial 
analysis as described in the preceding report on the study. 

V/ith this enclosed supplement to that report they nov/ attempt 
to discover more detailed and specific trends and relationships 
that might possibly be revealed by the relative components of 
these data as obtained In the study. 



Tlie heartbeat of the analysis used herein depends upon 
computing the variance of the data as the mean square (M3) 
deviation of each of the items from the grand mean (jc or GN) 
of all the items In the data set under consideration. Since, 
according to Moroney, a small sample tends to underestimate 
the true variance of the parent population a better estimate 
is usually obtained by dividing the sums of the squares 





• 3 J j by the nunibar of dcyr^i^s. of freedom 

' — ' .. t: ^ 

in the sample as: \ ( X - X )~". 

^ ' M.-I ‘ 



5 

George \!, Snedecor, 
lov/a State College Press, 



Statistical Methods, 
\<m, pp. 2^-25. 



/^oes. 



lov/a: 



This approach to the data analysis requires that the 
invest inator must compute the sum of the squares (SS) and the 
degrees of freedom (DF) for each source of variability 
considered. 

As indicated above, the number of degrees of freedom on 
v/hich any particular SS Is computed v/ill be one less than the 
number of ltcr.is on vrtiich a given calculation is made, or 
DF ^ n-i. 

The next consideration in the is based on the 

assumption that the samples v/lll not have the same average 
values but should vary ‘betv/een** anv tv/o given sample groups 
according to the difference reflected by the particular members 
•‘V/lthin*‘ each sample group— ALL ELSE REIi/\iniL’G CONSTATn*. In 
the v/ords of Moroney then: 

•‘...IThat v/e should expect in these circumstances is that 
the variation betv/een sample averages should be commen- 
surate \7ith the population variance as Indicated by the 
variation v;lthin the individual samples. If it should 
prove that the » between sample variation* v/ere 
significantly greater than the *v/ithln sample variation*, 
then v/e should suspect that the samples v/ere not. In 
fact, drav/n from the same population, but from populations 
v/liose average values differed, so that on top of the 
*v/lthln population variation* thr 'e existed also a 
* betv/een population variation*.'*- 

As stated elsev/i^erc In this Sum I cment To Tlie Report the 
analysis of variance technique is a complete and detal leTapproach 
that, being more sensitive to the respective sources of variation, 
v/as used herein to account for the performances wLthJn groups 
and performances bj^tv/xerv groups and make the proper^*dVtcrml nations 
based upon the ratio of one source of variation to the other. 

In other words, the Investigator v/as concerned at this point v/ith 
the variation among the classes/days/v;eeks and the combinations 
of these variations that v/ould proportionally be out of step with 
the degree of variant I on found v/ithl.n any particular sample among 
the member elements therein— thus indicating some possible 
source and/or degree of significant variation resulting from 
differential treatment appearing In the experiment, either Intention- 
ally or unintentionally. 

It is hoped, therefore, that proper utilization of the AIWA 
has resulted In an adequate accounting for each group *s score in 
terms of variation among Individual scores (class) as well as 
providing some Indication for sources of variation. If any, 
caused by or related to some aspect of the experimental manipu- 
lation. As shov/n by the AIWA tables of calculations, an attempt 
v/as uiso made to further indicate the variance betv/een groups as 
a function of a single variable and also as a function of some 
combination of possible interaction betv/een these variables. 
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The detaifed explanation of these computations and the 
rationale behind each usage is rather involved and no attempt 
will be made to present an in depth discussion at this point. 

To facilitate interpretation and estimations based on 
results of the study, the data and all computations are 
presented, ivlierever practical, in chart of tabular form. It 
is hoped that this v/ill simplify the task of evaluation for 
the reader. 



SUM4ARY 



A Brief Review Of Procedure: 

1. Tlie basic measure of variance, as used in this study, 
is the mean squared^deviation from the grand mean, 

or notat ional ly: (X - 

2. Remember also that the investigator v/as concerned 
first v/ith the total amount of variation in the 
results, regardless of the source. 

3. The next step v/as to calculate the variance v/lthin 
each group and establish Its ratio to the computed 
betv/een-groups var i ance . 

4. The latter variation v/as attributed to the differential 
treatment of the sample and as the total between groups 
variance It v/as compared to the previously calculated 

V/ 1 thin groups variance (see 3 above) for some degree 
of significance. 

5. Tlie ratio established in 3 and 4 above is sometimes 
referred to as the SIGNIFICAT>!CI£ RATIO and as such it 
v/as compared with an F table of previously established 
values,'^ 



report. 



Please see discussion of F table on page 10 of this 
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THE STATISTICAL ANALYSIS OF VARIANCE 



For purposes of this study significance was determined by 
ratio comparison of the bctv/een sample variance/with In sample 
variance estimates v/ith a Fishcr^s significance table as 
reproduced from George W, Sncdecor.^ The resulting estimates 
were stated in terms of an F and symbolized as Table Values 
v/hich were either: (I) greater than the computed value 

or (2) less than the computed value )- 

This writer considers the footnoting for each table as 
adequate for purposes of clarif Ication and will at this time 
merely call the readers attention to the follov/ing items. 

First, the column headings are: 

1. SOURCE, or the different experimental conditions. 

2. OF or degrees of freedom. 

3. MS or mean squares. 

4. F value as computed 

An understanding by the reader of the first (source) and last 
(F) are all that Is required to make an adequate interpretation 
of the tables. 

Second, for purposes of this study the F ratio was in all 
instances determined at tv/o levels of confidence (I) the .01 or 
\% level of confidence and (2) the .05 or 5^ confidence level. 

The probability indication is that any variation of the degree 
revealed by the data processing analysis included herein would 
be expected to occur by chance alone (I) one time in every one 
hundred (l/lOO) and (2) five times In every one hundred (s/lOO) 
respectively. The ability to reject the Mull Hypothesis (Hq) 
is indicated for each particular ratio throughout the comparison 
tables. 

The nonsignificant mean effects and/or interactions with 
the resulting failures to reject the Null Hypothesis are likewise 
indicated by the tables. 

The statistical analysis now follows and begins with a 
summation chart for the total variance followed by dally sub- 
total calculations, ANOVAS for main effects, interaction and 
sumation charts for purposes of revealed significance. 



Snedecor, 



loc. cit. 



TOTAL VARIANCE: ALL SOURCES 



FOR ALL TREATMENT \CEKDAYS-*- 
Mondays Through Fridays 



ACCORDING TO: 



VAR 

total 




^ijl< - 



VAR 

total 





VAR 



Mons. 



+ VAR 

Tues. 




Mondays subtotal - 
Tuesdays subtotal ~ 
V/€dnesdays subtotal ~ 
Tliursdays subtotal = 
Fridays subtotal = 



13.5041 

32.4132 

IS.343I 

13.5041 

05.67% 



83.4441 = GRAI-30 TOTAL FOR DAYS 

MONDAYS THROUGH FRIDAYS 



MOt'lOAY 



{Score 



GM)^ = (mif 



{0.42Y; 

(0.41):; 

(0.42); 

(0.69); 

(0.72)? 

(0.77)? 

(1.14) ^ 
(0.07)2 
(1.12)2 
(0.77); 
(1.05); 
( 0 . 88 ); 
(I.^i6):: 
(1.60); 

(1.14) ; 
(1.26)? 
(0.80); 
(0.05); 
( I .55)" 
(0.92); 
(0.09)? 
(0.43); 
(0.58); 
(0.38)"^ 



Monday subtotal 



VAR 

Monday, 
0. 1764 
0.1681 
0. 1764 
0.4761 
0.518^:. 
0.59.'?9 
1.2996 
0.004-9 
I . 2544 
0.5929 
3.4225 
0.7744 
2.1316 
2.5600 
1.2996 
I.5C76 
0.6400 
0.0025 
-^ 10.25 
0. 6494 
0.0081 
0. ia;9 
0.336/i- 
0. 1444 



13.5041 
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TUESDAY 



(Score - GH)’’ = (TUE)2 

{0.4?)2 


= 


VAR 

Tuesday 




0.E40I 


(0.10)^ 


= 


0.0324 


(0.24)^ 




0.057& 


(1.11)2 


— 


1.2321 


(o.oo)-' 


S= 


0.0064 


(1.22)^ 


= 


I 


(0.14)2 




0.01% 


(0.05)2 




0.7225 


(1.30)2 




1.84% 


(1.05)2 


= 


1.1025 


(0.53)^ 


= 


0.3624 


(0.60)5 




0.4624 


(0.56), 


= 


0.3136 


(0.97); 

(0.52)2 


rr 


0.9409 




0.38^14 


(0.18)2 


= 


0.3424 


(0.32); 




0.1024 


(0.90); 




0.8100 


(0.95)2 




0.9025 


(0.78); 




0.6084 


(0.61); 


= 


0.3721 


(0.04) 


= 


0.0016 


(0.95); 


r= 


0.9025 


(0.87)2 




0.7569 


(0.42); 




0.1764 


(1.53)2 




2.3409 


(1.34)2 




1 .7956 


(1.14)2 


r= 


1 .2996 


(0.66); 


=s 


0.4356 


(1.26); 


rr 


1 .5876 


(2.11)2 


rr: 


4.4521 


(1.18)2 

(1.38); 


= 


1 .3924 


rr 


1.9044 


(1.68) 


m 


2.8224 


Tuesday subtotal 


rr 


32.4132 
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V,EDt€SDAY 



(Score - GM)^ = 



(VEor 

(0.20)2 

(1.36) | 
(0.70)‘ 
( 1 . 19 ); 
(0.45)2 
(0.25)2 
(0.64)2 
(0.57); 
(0.44), 
(0.32)2 
( 0 . 12)2 
(1.44)2 
( 0 . 68)2 
(0.82); 
(0.60)? 
( 0 . 21 ); 
(0.01 )f 

(1.37) ? 
(1.36)2 
(1.01)2 
(1.27)2 
(0.47)2 
(0.32)2 
(0.52); 
(0.24)2 
(0.95)? 
(0.32)? 
(0.33)2 
(0.14)? 
(0.47)5 
(0.99)? 
(0.51); 
(0. 14)2 



VAR 

V/ednesday 

0.0400 

1.8496 

0.4900 

I.4S6! 

0.2025 

0.0625 

0.4096 

0.3249 

0.1936 

0.1024 

0.0144 

2.0736 

0.4624 

0.6724 

0.3600 

0.0441 

0.0001 

1.8769 

1.8496 

1.0201 

1.6129 

0.2209 

0.1024 

0.2704 

0.0576 

0.9025 

0.1024 

0.1089 

0.0196 

0.2209 

0.9801 

0.2601 

0.0196 



V/ednesday subtotal 



18.3431 



THURSDAY 







I 



P-- 

I 







f. 



L 

I' 

I- 

f 



(Score - GH)^ = (THUR)^ 

(O.S9)^ 


= 


VAR^ ^ 
Thursday 


— 


0.7921 


(0.93)2 

(0.78); 


= 


0.S6^|.9 


=2 


0.608/!- 


(0.82); 


= 


0.6724 


(0.58); 




0.3364 


(0.34), 


S= 


0.1156 


(0.S2), 




0.6724 


(0.51)2 


= 


0.2601 


(0.86); 




0.7396 


(0.42); 


= 


0.1764 


(0.67); 


=: 


0.4489 


(0.12), 


2 = 


0.0144 


(0.62), 


2 = 


0.3844 


(0.96); 


£= 


0.9216 


(0.62), 


S= 


0.3844 


(0.06); 


— 


0.0036 


(0.61), 




0.3721 


(1.03); 




1.0609 


(0.98); 


= 


0.9604 


(0.18); 


s= 


0.0324 


(0.34), 


r= 


0. 1 156 


(0.42); 


= 


0.1764 


(i.oo; 


s: 


1.0201 


(0.28); 


=s 


0.0784 


(0.13)2 




0.0169 


(0.43)2 


=: 


0.1849 


(0.54); 




0.2916 


(1.22); 




I.48S4 


(0.52)2 


= 


0.2704 


(0.20)2 


rz 


0.0400 


Thursday subtotal 




13.5041 
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FRIDAY 



(Score - Gli)^ = (fri)^ 

(0.1 1 
( 0 . 6 !)^ 

(0.51)^ 

(0.60)^ 

(0.14)^ 

(0.70)^ 

( 0 . 22 )^ 

(O.ll)^ 

(0.63)^ 

(0.09)^ 

( 0 , 01 )^ 

(0.53)^ 

(0.45)^ 

(0.62)^ 

(0.42)^ 

(0.74)^ 

(O.ll)^ 

(0.32)^ 

( 0 . 12 )^ 

(UOO)^ 

Friday subtotal = 

(Total variance calculations on page 12) 



VAR 



Fr I day 



0.0121 



0.3721 

0.3721 



0.3600 



0.0196 
0.4900 
0 . 0^!^4 
0.0121 
0.4624 
O.CICO 
0.0001 
0.2G09 
0.2025 
0.30^4 
0. 17CW!. 
0.5476 
0.0121 
0.1 024 
0.01^4 
1.0000 



5.6796 
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Table Number I 



MAIN EFFECT: DAYS 

AI’ALYSIS OF VAHIANCE-- 
Computation For Sums Of Sqi 



SS^ ACCORDING TO: 
days 



2 




/'Mean for \ 
each class ) 
Vail classed 



24(3.13 - 3.18)^ = 0.0600 

34(3.17 ~ 3.18)^ = 0.0034 

33(3.17 - 3.18)^ = 0.0033 

30(3.34 - 3.18)^ = 0.7680 

2 

20(3.11- 3.18) = ,0980 



0.9327 = SS 



days 



Table Mumber 2 



MAIN EFFECT: ICEKS 

AMALYSIS OF VARIANCE-- 
Computst j on For Suins Of Squares 



TO’- 





J_ (X. 

j 


*k *■ 




kH 










t 

/ 


\ 




/ 

/ 


\ 


j Mumber 


of \ 




( Day 


^ Grand \ 


\ weeks/s ituat ions i 




\ mean 


mean / 


V 

\ 


/ 




\ 


/ 

y 




29(3.06 


- 3. 


18)^ = 


0.4176 




29(2.98 


- 3. 


18)^ = 


1.1600 




30(2.93 


- 3. 


18)^ = 


1.8750 




26(3.57 


- 3. 


18)^ = 


3.9546 




28(3.36 


- 3. 


18)^ = 


0.9072 



8.3144 = 35 . 

v/eeks 
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Table Number 3 



MAIN EFFECT: CLASSES 

ANALYSIS OF VARIANCE— 
Computation For Sums Qf Squares 



SS ACCORDING TO; 

classes 






Jlc 



i-i 



(X... - 



Number of 
c 1 asses/ s I tuat i onsi 

/ 




25(3.06 - 3.l8r = 
25(2.90 
25(2.93 
25(3.57 
25(3.36 



- 3. 18) = 

- 3.18)^ ^ 

- 3.18)^ == 



-3.18) = 



0.3600 

1.0000 

1.5625 

3.8025 

0.8100 



Grand 

mean 



7.5350 = SS 



classes 



no 




Table Number 4 



INTERACTION: DAYS BY CLASSES 

ANALYSIS OF VARIANCE 
Computation For Sums Of Squares 



SS . ^ ACC0RDII4G TO; 
a X c 



5 7 




j=l k=l 



(X 



ij' 



- X 




+ X... 



) 



2 



No. of scores \ XCIass mean for Mean for 

In Individual 1/ a^LL Mondays, each day 

cell J[ Tuesdays, V/ednesdays - of the 

- V Thursdays and study 

\ Fridays 



Mean of 
whole 

group for -i- 

individual 

day 



MO^^)DAY 

5(2.61 - 3.06 - 3.13 + 3.18)^ == 0.8000 

5(3.17 - 3.06 - 3.17 + 3.18)^ = 0.0720 

2 

5(3.08 3.06 - 3.17 + 3. 18) == 0.0045 

4(3.38 - 3.06 - 3.34 -i- 3. 18)^ == 0. 1024 

5(3.48 - 3.06 - 3.11 3.18)^ = 1.2005 



2.1794 = Subtotal SS 

Mon. 



TUESDAY 

7(3.15 - 
7(2.64 - 
7(3.09 - 
6(3.48 “ 
7(3.41 - 



2.98 - 3.13 + 

2.98 - 3.17 + 

2.98 - 3.17 + 

2.98 - 3.34 + 

2.98 - 3.11 + 



3.18)^ == 0.3388 

3.18)^ = 0.7623 

3.18) ^ == 0.1008 
2 

3.18) = 0.6936 

3.18) ^ = 1.7500 




3.6455 = Subtotal SS^ 

Tue. 



Ill 



V/EONESDAY 



7(3.28 - 2.93 - 3. 
7(2.94 - 2.93 - 3. 
7(2.71 - 2.93 - 3. 
6(3.83 - 2.93 - 3. 
6(3.01 - 2.93 - 3. 

THURSDAY 

6(3.50 - 3.57 - 3. 
6(3.33 - 3.57 - 3. 
6(2.95 - 3.57 - 3. 
6(3,50 - 3.57 - 3. 
6(3.43 - 3.57 - 3. 

FRIDAY 

4(2.79 - 3.36 - 3. 
4(2.81 - 3.36 *- 3. 
4(2.8! - 3.36 - 3. 
4(3.68 - 3.36 - 3. 
4(3.48 - 3.36 - 3. 



er|c 



+ 3.18)^ * 1.1200 
2 

+ 3.18) = 0.0028 

+ 3.18) = 0.3087 

+ 3.18)^ = 3.2856 
2 

+ 3.18) =0.1350 

4.8521 = Subtotal SS 

V/€d. 

2 

+ 3.18) = 0.0024 
2 

+ 3.18) =0.3174 
2 

+ 3.18) = 2.2326 
2 

+ 3.18) =0.3174 
+ 3.18)^ = 0.0294 

2.8992 » Subtotal SS 

Thur. 

+ 3.18)^ = 1.0816 
+ 3.18)^ = I. 1664 
+ 3.18)^ = 1.1664 
+ 3.18)^ = 0.1024 
+ 3.18) =0.1444 

3.6612 = Subtotal SS^ . 



13 

17 

17 

34. 

II 

13 

17 

17 

34 

11 

13 

17 

17 

34 

II 
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GRAND TOTAL SUM OF SQUARES FOR INTERACTION DAYS BY CLASSES 



Monday subtotal 
Tuesday subtotal 
V/ednesday subtotal 
Thursday subtotal 
Friday subtotal 



== 2. 1794 
= 3.6455 
=* 4.G52I 
= 2.8992 
3.6612 

17.2374 = GRAND TOTAL SS^ ^MONDAY THROUGH 



FRIDAY 






Table NujBber 5 



l^rro^ACT^ON: DAYS BY \EEKS 

ANALYSIS OF VARIANCE— 
Cornpiitat i on For Syms Of Squares 



SS 



d X w 



ACCORDING TO? 



5 7 

X x; 

z. ^ 

1 *==! Ur^l 

Number of 
scores in 
block 



(X 



i'k 



X j , .*«X* 'I' X, , , ) 



/Nean of Nean of day Mean of all 
I individual - over the •» class over 
Vday seven weeks Individual 
\ week 






V/EEK NUMBER ONE 

5(3.71 - 3. 13 « 3.36 + 3. 18)^ - 0.8000 

5(3.30 - 3. 17 « 3.36 + 3. 18)^ = 0.0125 

.2 

= 0.2205 



5(3.14. - 3.17 - 3.36 3.13) 



VCEK NUMBER T./O 



1.0330 ~ Subtotal SS 



d X w 



5(3,95 - 3. 13 - 3.92 + 3, ler = 0,0320 

5(4. 10 - 3, 17 - 3.92 + 3, 10)^ = 0,54!lS 

2 

3(3.67 - 3. 17 - 3.92 -1* 3. 18) = 0. 1728 
5(3.98 - 3.34 - 3.92 + 3. 18)^ == 



0.0500 
0.7993 = Subtotal SS 



\7EEK NUMBER 7MREE 



d X w 



4(3.96 - 3. 17 - 3.78 + 3, 18) = 0. 1444 
5(3,60 - 3, 17 - 3.78 + 3. 18)^ = 0, 1445 
5(3,77 - 3. 14 - 3.78 + 3. 18)^ = 



0.0045 

0.2934 = Subtotal SS 



d X w 
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iiiiliSliittttiuiii 



V/EEK NUMBER FOUR 



5(3*74 - 3,17 - 3,43 + 3.18}^ = 0,5120 
5(3,23 - 3, 17 - 3,43 + 3. 18)^ « 0, 1805 
5(3.73 - 3.34 - 3.43 + 3.18) = 0.0980 
5(3.01 -3.11 - 3.43 + 3.18)^ = 0.6125 



VIEEK NUl'SER FIVE 

5(1.79 - 3. 13 - 2.65 3.18)^ 

5(3.26 - 3. 17 - 2.65 -r 3. 10)^ 
5(2.48 - 3.17 - 2.65 - 1 - 3.18)^ 
5(2.61 - 3.34 - 2.65 + 3.18)^ 
5(3.09 - 3.11 - 2.65 + 3.18)^ 

VIEEK NUI4BER SIX 

4(3.06 - 3. S3 - 2.89 + 3.18)^ 

2 

5(2.16 - 3.17 - 2.89 1 - 3.18) 
5(3.14 - 3.17 - 2.89 + 3.18)^ 
5(2.19 - 3.3-; - 2.89 + 3.18)^ 
5(3.19 - 3.11 - 2.89 + 3.18)^ 

VIEEK NUI4BER SEVEN 

5(3.14 - 3.13 - 2.79 + 3.18)^ 

5(1.66 - 3.17 - 2.79 + 3.18)^ 

2 

5(2.93 - 3.17 - 2.79 ^ 3.18) 
5(3.06 ~ 3.34 - 2.79 + 3.18)^ 
5(3.17 « 3.11 - 2.79 + 3. 18)^ 



1.4033 == Subtotal SS 

d X tf 

= 3.2805 
== 1.9220 
== 0.0256 
= 0.2000 
== 0. 1300 

5,5581 == Subtotal SS 

d X W 

= 0, 1936 
== 2.5920 
= 0.3380 
= 3.6980 
= 0,6845 

7.5061 = Subtotal SS^ ^ 

d X V? 

= 0,8000 
« 6.2720 
=» 0.1125 
= 0.0121 
* 1.0125 

w. <»Hll «• vp»« 

8.2091 = Subtotal SS^ „ 

d X V 






GRAfJD TOTAL SUM CF SQU*V?ES FOR INTERACTION DAYS BY V£EKS 



Week Number One subtotal = I.C330 

V/eek Number Tvm subtotal = 0,7993 

V/ssk Niiusber Three subtotal = 0.2934 

V/eek Number Four subtotal = 1.4033 

V/eek Number Five subtotal == 5.5581 

Week Number Six subtotal == 7.5061 

V/eek Number Seven subtotal = 8.2091 

24.8023 = GRAND TOTAL SS^ ^ V/EEK 

d X V/ 

laJMBER ONE THROUGH V/EEK 
IvlUl^BER SEVEi'i 
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Table Number 6 



HTTERACTION: CLASS(ES) BY ViEEK ONE (l) 

ANALYSIS OF VARIANCE— 
Computation For Sums Of Squares 



SS „ ACCORDING TO: 
C X Wj 



/ N scores {X - X. - X.. + X.,.r 
/ J *' J k 




j/Vary the ciasses^ 
I I through 5 over 
I the weeks 1 
psthrough ? 




CLASS V7EEK itlHBER ONE 

I 3(9.67 / 3 - 3.06 - 3.36 -J- 3.18}^ = 0.0012 

It 3(8.41 / 3 ~ 2.98 - 3.36 3.18)^ = 0.3888 

2 

1 1 1 3(9.50 / 3 - 2.93 - 3.36 '5- 3. IS) ~ 0.0108 

V 3(12.53 / 3 - 3.57 - 3.36 I- 3. 10)^ ==0.5547 

VI 3(10.63 / 3 - 3.36 - 3.36 -I* 3.18)^ =0.0000 



0.9555 



= Subtotal SS „ 

c X Wj 



cuss 

I 

II 

III 

V 

VI 



CLASS 

I 

II 

III 

V 

VI 



CLASS 

I 

II 

III 

V 

VI 



IIITERACTIOI^!: CLASS(ES) BY \!EE\{ Tl/0 (2) 

\£EK MUK8ER Tl/0 

4(15.85 / 4. - 3.06 - 3.92 + 3.18)^ = 0.1024 
4(15.57 / 4 - 2.98 - 3.92 + 3.18)^ = 0.1 156 
4(14.99 / 4 - 2.93 - 3.92 + 3.18)^ = 0.0100 
3(12.84 / 3 - 3.57 - 3.92 + 3.18)^ = 0.0027 
3( 11 . 94/3 - 3.36 - 3.92 + 3. 18) =* 0.0432 

0.2749 = Subtotal SS ^ 

C A 

I INTERACT 1 01^: CLASS(ES) BY V/EEK THREE (5) 

V/EEK IvlUMBER THREE 

. 2 
3 ( 11 . 25/3 - 3.06 - 3.78 + 3.18) = 0.0243 

3(10.72 / 3 - 2.98 - 3.78 + 3.18)^ = 0.0003 

2 

3(10.49 / 3 - 2.93 - 3.78 + 3.18) == 0.0147 
2(08.66 / 2 - 3.57 - 3.78 + 3.18)^ 0.0512 

3(11.61 / 3 - 3.36 - 3.78 + 3.18)^ = 0.0243 

0.1148 = Subtotal SS ^ 

C X w. 

ILTHRACTION: CLASS(ES) BY V/EEK FOUR (4) 

V.CEK HUMBER FOUR 

4(14.72 / 4 - 3.06 - 3.43 + 3.18)^ = 0.5476 

4(12.41 / 4 - 2.98 - 3.43 + 3.18) = 0.0676 

4(13.76 / 4 - 2.93 - 3.43 + 3.18)^ = 0.0784 

4(15.17 / 4 - 3.57 - 3.43 + 3.18)^ = 0.0036 

4(11.96 / 4 - 3.36 - 3.43 + 3.18)^ = 0.5476 

1.2448 = Subtotal SS^ y ^ 

C A W ^ 
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.MTERACTION: CLASS (ES) BY \€EK FIVE (5) 

CLASS \CEK NUMBER FIVE 

2 

I 5(11.15 / 5 - 3.06 - 2.65 + 3.18) = 0.4500 

II 5(12.57 / 5 - 2.98 - 2.65 + 3.18)^ = 0.0180 

III 5(11.99 / 5 - 2.93 - 2.65 + 3. IS)"" = 0.0000 

V 5(15.42 / 5 - 3.57 - 2.65 + 3.18)^ = 0.0080 

VI 5(15.04 / 5 - 3.36 - 2.65 + 3.18) = 0.1620 

0.6380 = Subtotal SS^ ^ ^ 









livlTERACTION: CLASS(ES) BY 


V/EEK SIX (6) 


CLASS 












V£EK NUMBER 


SIX 




1 


5( 


14.41 


/ 


5 


- 3.06 


- 2.89 + 3. 


18)^ 


= 0.0605 


II 


5( 


13.70 


/ 


5 


- 2.98 


- 2.89 + 3. 


18)^ 


= 0.0180 


III 


5( 


12.20 


1 


5 


- 2.93 


- 2.89 + 3. 


18)^ 


= 0.2000 


V 


4( 


12.24 


/ 




- 3.57 


- 2.89 + 3. 


18)2 


= 0.1936 


VI 


5( 


16.75 


/ 


5 


- 3.36 


- 2.89 + 3. 


18)2 


= 0.3920 



0.8461 = Subtotal SS 

INTERACTION: CLASS(ES) BY ViEEK SEVEN (7) 



CLASS WEEK NUMBER SEVEN 



1 


5( 


13.27 


/ 


5 


- 2.06 


- 2.79 


+ 


3.18)^ 




0.0020 


II 


5( 


12.76 


/ 


5 


- 2.98 


- 2.79 


+ 


3.18)^ 


= 


0.0080 


III 


5( 


12.61 


/ 


5 


- 2.93 


- 2.79 


+ 


3,18)^ 




0.0020 


V 


5( 


16.25 


/ 


5 


- 3.57 


- 2.79 


+ 


3.18)^ 




0.0245 


VI 


5( 


14.90 


/ 


5 


- 3.36 


- 2.79 


+ 


3.18)^ 




0.0005 



0.0370 = Subtotal SS^ ^ ^ 

CAW, 
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Chart Number 7 



SUM1ARY CHART: SS CLASS BY \CEKS 

» rERACTION FOR c X w 

k- 1-7 



V£EK 






(i) 


c X Wj 


Interaction SS - 0.9555 


(2) 


C X \l 
2 


Interaction SS - 0.2749 


(3) 


c X 


Interaction SS = 0.1148 


(4) 


c X w, 

4 


Interaction SS = 1.2448 


(5) 


c X 

5 


Interaction SS = 0.6380 


(6) 


c X w, 
o 


Interaction SS = 0.8461 


(7) 


c X 


Interaction SS = 0.0370 



c X V/. 



k= 1-7 



4. 1 1 1 1 = GRAf4D TOTAL SS 



MAIN EFFECT: DAYS 

Calculation For F~Ratlo 



Table Number 8 



F-ratlos for 1^^ == 0.2332 at 4 over (62 + 24) degrees of freedom. 



ACCC3RDING TO RATIO COMPARISON: 

No significance revel aed by analysli and comparison of these 
obtained data at the confidence levels indicated. The 
investigators failed to reject at levels shown above. 

KEY FOR F OETERMINATIOi^ AND ANALYSIS: 

Table Va !ue ^ Computed Value - No significant variation In 
data obtained under the conditions considered according 
to determinations and analysis app I i ed-—unab I e to reject H^. 

Table Value ^ Computed Value = Th er e Is a s i gn i f i cant var i at I on 
in data obtained under the conditions considered according 
to determinations and analysis applied-lability to reject 
Kq is indicated. 



U 



MS 



F 



d 



d 



MS 



+ MS 



c X w 



res 




0.3308 + 0.2569 



CALCULATED VALUE = 
d 



0.3968 



RESULTS 



Table F Value @ 4/so D.F. for 1^ 
confidence level = 




Table F Value @ 4/so D.F. for % 
confidence level = 



Table F Value @ 4/iOO D.F. for 
confidence level - ......... 



Table F Value @ 4/iOO D.F. for % 
confidence level = 
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MAIN EFFECT: CLASSES 

Calculation For F-4?atlo 



Table Number 9 



F-ratlos for MS^ = 1.8837 at 4 over (62+ 24) degrees of freedom. 




MS 

res 



MS 



d X w 



= 1*8837 

0. 33(58 + 1.0334 



CALCULATED F VALUE = 



1 .3009 



RESULTS 



Table F Value 4 / 8 O D.F. for \% 

confidence level - 

Table F Value ^ 4 / 8 O D.F. for 5^ 

confidence level - ..2.48 

Table F Value (? 4/100 D.F. for 1% 

confidence level - 

Table F Value (? 4/100 D.F. for % 

confidence level - 2.46 




ACCORDING TO RATIO COMPARISON: 

No Significance revealed by analysis and comparison of these 
obtained data at the confidence levels indicated. The 
Investigators failed to reject H at levels shown above. 



KEY FOR F OETERI'IINATION AND ANALYSIS: 

C ompute d Value == No significant variation In 
data obtained under the coiiditions considered according 
to determinations and analysis app 1 1 ed*— unab I e to reject H^. 

ISkle Cj?^ There Is a significant variation 

In data obtained under the conditions considered according 
to determinations and analysis applied — abll’ty to reject” 
Hq is Indicated. 
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MAIN EFFECT: VJEEKS 

Calculation For F-Ratio 



Table Number 1C 



F-ratlos for MS = 1.3857 at 6 over (62 + 22) degrees of freedom. 



w 



= \i ^ , 

IB ^ ^ 
res c X d 



=" 1 .38 57 

0.3308 *i- 0.7186 



CALCUUTED F . VALUE = 1 .3205 

w 

Table F Value @ 6/sO D.F. for ifo 

confidence level - 3. 04- 

Table F Value @ 6 /do D.F. for 5% 

confidence levei - 2.21 

Table F Value (? 6/lOO D.F. for \% 

confidence levei - 2.99 

Table F Value @ 6/lOO D.F. for 5% 

confidence levei = .2.19 



ACCORDING TO RATIO COMPARISON: 

No significance revealed by analysis and comparison of these 
obtained data at the confidence levels indicated. The 
Investigators failed to reject H at levels shown above. 



KEY FOR F DETERMINATION AND ANALYSIS: 

Tab.ie VaJjie^ Comput ed , Value f= No s I gn I f I cant var I at I on In 
dVt^ obtained under the conditions considered according 
to determinations and analysis applied — unable to reject H^. 

Table Value ComputM Value = There is a significant variation 
in data obtVlned under the conditions considered according 
to determinations and analysis applied — ability to reject 
Hq Is indicated. 



RESULTS 
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Tab Is Number II 



INTERACTION: DAYS VS. V/EEKS 

Calculation For F-Ratio 



F-ratlos for MS^ = 1.0334 at 24 over 62 degrees of freedom 

d X w 



F 



d X w 






MS 



d X V/ 



res 



= J..J834 
0.3308 



CALCULATED ^ VALUE == 



3. 1239 

RESULTS 



Table F Value 0 24/60 D.F. for \% 

confidence level = 2.12 

Table F Value 0 24/60 D.F. for 5 % 

confidence level - 1.70 

Table F Value 0 24/65 D.F. for \% 

confidence level = 2.09 

Table F Value 0 24/65 D.F. for 5 % 

confidence level == 1.68 




ACCORDING TO RATIO COMPARISON; 

The analysis and comparison to which these data were subjected 
indicate a significant variance related to interaction of the 
considered effects at the above levels — the investigators were .. 
able, therefore, to reject Hg at aii confidence levels indicated 
above. 



KEY FOR F DETERMINATIOt'l AMD ANALYSIS; 

Table Value Computed Value = No significant variation in 
data obtained under the conditions considered according 
to determinations and analysis applied — unable to reject Hg. 

Table Value Confu te d Value = There is a significant variation 
fn dVta obtai^^^^ under the conditions considered according 
to determinations and analysis applied — ability to reject 
is indicated. 

0 
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Tabu Number 12 



INTERACTIOfh DAYS VS. CLASSES 
Calculation For F-Ratio 



F-ratlos for IIS^ x c ~ 0*7186 at 16 over 62 degrees of freedom. 



F . 
CX d 




MS 



res 



= 0-JJ8A 

0.3308 



C/vLCUUTED Fj ^ g VALUE = 2.1720 



Table F Value @ 
confidence 


16/60 

level 


D.F. for 1^ 




RESULTS 


Table F Value 6 
confidence 


16/60 

level 


D.F. for 5 % 


1 .81 


Table F Value G 
confidence 


16/65 

level 


D.F. for 


2.30 


< dX c 
c 

<^'^dX e 


Table F Value C 
confidence 


16/65 

level 


D.F. for 5 $ 


1,80 







ACCORDING TO RATIO COMPARISON: 

i« The above determinations reveal some degree of interaction 
related to days vs. classes that appear to contribute to a 
significant variation at the .05 level for these data 
analyzed.* 

2. No significance revealed for these data at the \% level.** 
*Rejected Hq at Indicated levels of confidence for these data* 
**Failed to reject at levels indicated for these data. 

KEY FOR F DETERMINATION AND ANALYSIS: 

Table Value Computed Va l ue - No significant variation in 
data obtained undV the conditions considered according 
to determinations and analysis applied— unable to reject H^. 

Table Valu e ^ Computed Value = There Is a significant variation 
in data obtained under the conditions considered according 
to determinations and analysis appi led— abi I Ity to reject 
Hq Is indicated. 

er|c 
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Table Number 13 

INTERACTIOrh CLASS VS. ICEKS 
Calculation For F-Ratio 



F— ratios for MX „ — 0.2569 at 24 over 62 degrees of freedom. 

c X w 




MS 

X = c X V/ 



MS 



res 



= . 0.2569 
0.3308 



CALCUU7ED F^ v VALUE = ...0.7766 

Table F Value 24/60 D.F. for 

confidence level - 2.12 

Table F Value Q- 24/60 D.F. for 5^o 

confidence level - 1.70 

Table F Value @ 24/65 D.F. for 1^ 

confidence level - 2.09 

Table F Value @ 24/65 D.F. for 5^ 

confidence level - 1.68 



RESULTS 
■\ F 



c X w 



^ X w 



>^XW 

>"cx- 



ACCORDING TO RATIO COMPARISON: 

No Significance revealed by analysis and comparison of these 
obtained data at the confidence levels Indicated. The 
Investigators failed to reject at levels shown above. 



KE\’ FOR F DETERMINATION AND ANALYSIS: 

Table Value Com puted Valu e ~ No significant variation In 
data obtained under Ihe conditions considered according 
to determinations and analysis applied-unable to reject 

Table V alu e Computed Valu e = There is a sign! f I cant var I at i on 
in data obtained under the conditions considered according 
to determinations and analysis app 1 1 ed— -ab II i ty to reject 
Hq Is Indicated. 
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Chaft Humber 14 



AJ’OVAj 



DETAILED SUHH/\RY CHART FOR IHTERACTIOHS AS ^aiRCES OF Er^RORS 



SOURCE MS DEGREES OF D.F. RESULT OF COiiP/\RISOH \/)TH 

ILTERACTIOU FREEDOM FISHER^S F T/\BLE* 

RATIO A3 
COr^lPUTED 



SS/df ‘between/ 
within* 



Calculation 
F Value 



DAYS 

BY 1.0334 24/&2 

liEEKS 

CLASSES 

DY 0.7106 16/62 

DAYS 

CLASSES 

BY 0.2560 24/62 

V£EKS 




24/60 

3.1239 

24/65 

^ ^ 4 « • % 

16/60 

2.1720 

16/65 

a .^/60 

0.7766 

2/I./65 







(+)””T-i-'r 

(•!-) (+) 
(-) (-F) 

(-) ('ll 

( T ^ T ) 

C-) (~) 



♦ (*h} == Significance |S Indicated at the confidence level (s) considered. 

(-) ~ Significance IS MOT indicated at the confidence level(s) 
considered. 
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Chart Number !5 

ANOVA: SUNWARY CHART FOR MAIN EFFECTS AS SOURCES OF ERRORS 



MAIN 

EFFECT 

SOURCE 


MS 


DEGREES OF 
FREEDOM 
RATIO AS 
COMPUTED 


O.F. 


RESULT OF COMPARISON WITH 
FISHER’S F TABLE* 




ssTdf 


"Between/ 




Calculation .a 








within" 




F Value 




















DAYS 


0.2332 


4/86 


4/80 


0.3%8 


(-) 


(-) 








4/100 




(*“) 


(-) 


CLASSES 


1.8837 


4/86 


4/80 


1 .3809 


(-) 


(-) 








4/100 




{-) 


(-) 


ICEKS 


1 .3857 


6/84 


6/80 


1.3205 


{-) 


(-) 








6/80 




{-} 


(-) 



* (+) = Significance indicated at the confidence level (s) considered. 

{-) - Significance IS NOT indicated at the confidence I eve I (s) 
considered. 









& 
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RESIDUAL VmmiCE 



ACCORD I i^G TOj 
RESIDUAL 

var 



RESIDUAL„^^ 

vor 



TOTAL - !DAY -I- CURSES >1- ViEEKS -i- 

var I var var var 

# 

(DAYS X '£EKS) -i- (D/C/S X CLASSES) 
var 

— } 

(CLASSES X V.EEKS) j 

var I 

^.A44.\ - (0.9327 1- 7.5350 r Q.3UA 1- 24.0023 I- 

4.11 II -! 17.2374) 



RESIDUAL = 20.5122 



Chart Number 16 



SUMMARY TABLE FOR ANALYSIS OF VARIANCE OF ERROR SOURCES 



ERROR 


SUM OF 


DEGREES 




COMPUTED 


D.F. 


RESULTS OF 


SOURCE 


SQUARES 


OF 


SQUARE 


SIGNIFI^ 


RATIO 


FISHER’S 






FREEDOM 




CANCE 


FOR 


SIGNIFI- 










RATIO 


COMPUTA- 


CANCE 










VALUE 


TIONAL , 
PURPOSES* 


RATI Op 












VALUE 



MAIN 

EFFECTS 


S$ 


-DF 


=MS 


F 






DAYS: (D) 
i-1,2,3, 
4,5 


0.9327 


4 


0.2332 


0.3968 


4:86 


( >)* 


CUSSES: 
(C) j= 
l,2,3,4,5 


7,5350 


4 


I. 8837 


I. 3809 


4:86 


( > )* 


V/EEKS: 
(V/) k=i, 
2,3,4, 
5,6,7 


8.3144 


6 


1 .3857 


I. 3205 


6:84 


( > )* 


INTER- 

ACTIONS 


SS r 

- 1- -T' m m 


•OF 


=MS 


F 






D X W 
1= k= 
1-5 1-7 


24.8023 


24 


I. 0334 


3.I239 


24:62 


(< )** 


D X C 
1= j- 
1-5 1-5 


I7.2374 


I6 


0.7I20 




24:62 


( < )•* 


C X W 
1- j= 
1-5 1-5 


4. 1 1 II 


24 


0.2569 


^'o.TtoV 


I6:62 


( >)* 


RES 

var 


20.5II2 




~0.^T68 








TOTAL 

var 


83.444I 


I40 


0.5960 ’ 









Based on the above analysis of these obtained data for this study, there 
is no Indication of a significant variation at the confidence level(s) 
Indicated, 

Based on the above analysis of these obtained data for this study, there 
Is indication of a significant variation at the confidence level (s) 
indicated, 

*As defined and used In this supplementary report, 

Herbert Arkin and Raymond R, Colton, Table s For Statisticians. New York; 
Barnes & Noble, Inc,, 1962, pp, 117-21, Comparison based on Snedecor*s 
modified Flsher^s Table of F Values. 



COtNlCLUStONS 



Based on the evaluation as contained In this report the writer 
concludes that the sources of between groups variance were traceable 
to an Indicated significance at the point of interaction of: 

1. DAYS with IVEEKS. 

2. DAYS with CLASSES. 

The analysis not only allowed the experimenters to detect significant 
performance difference related to differential treatment at the levels 
Indicated but also gave some Information as to which areas and/or 
combination of areas were more involved In these detected variations. 

Since the combined variables of: (I) days with weeks and (2) 
days v/lth classes accounted for a greater portion of the variance 
than was obtained by adding together the individual estimations of 
variance for each variable under consi derat ion^ the interaction was 
determined to be significant and confirmed by F tabte comparisons. 

No other variable reiationships analyzed in this study revealed 
any Indication of significance at the confidence levels considered. 
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INDICATIONS FOR TOE FUTURE 



According to Gsge: 

‘•The second erroneous notion seems to be that 
one experiment can and ought to shed light 
on oniy dne hypothesis.*,” 

Although fev/ If any solutions may be found v/fthin the limitations 
of this study^ it is felt that MANY related areas for potential 
investigation have been presented and/or suggested. This Investigator 
plans more precise and more controlled effort along these lines In the 
very near future and hopes that others v/lll also find some interest In 
the suggested areas of Investigation. 
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II 



II 

|2 

13 

Mon 14 
5 

b 

ir 



Tuc 



2.26 

tfelR 

1 : 2.69 

4 . 1 ! 4 == 22.08 

2.76 

7 [I. 92 ^ 

3.38 



Vifed 
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FrI 
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3.95 



I = 13.06 



1.33 - 
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RESEARCH TEAlHIilG 



FALL SEMESTER, 1967 
Course Outline 

Text Book; Defimley !?• Fundamentals of Measurement » New York: Oxford 



Part 1 


University Press. 

Tests & Testinx 


1. 


Introduction 

a. Philosophical and Psychological Principles of Measurement 
and Evaluation 

b. Basic Statistical Tools and vocabulary 


2. 


Scores, Norms and Evaluations 


3. 


Reliability and Validity 


Part 11 


Defining Objiectives 


1. 

2. 

3. 

4. 


Science and Scientific Approach 
Problems and Hyphotheses 
Constructs and Variables 
Planning lieasurement and Evaluation 



Fart III Instruments for Measurement 



1. 

2. 

3. 


Methods of Observation and Data Collection 
Constructing Instruments 
Standardized Forms 

a. Achievement 

b. Other Behaviorial Measures 


4. 

5. 


Factors in the Selection of Tests 
Measurement Ethics 


Part IV 


Preparing for the Research Proiect 

SUGGESTED READINGS 


Part I 


Tests & Testing 



Oownie « Chapters 1, 2, 3, & 4 
Ker linger • Chapters 5, 6, 7, 8, 23, 24, 6e 25 
Payne & McMorris • Chapters 1, 2, 3, & 4 
Lien - Chapter 1 

Schuts & Baker •> (Mimeographed) "The Experimental Analysis of Behavior" 

Garrett •> Chapters 1, 2, 5, ^ 13 

Gerlach et al - •‘Relative VS. Absolute Criteria" 



Part II Defining Objectives 



Gage - Chapter 2 
Bloom's Taxonomy 
Lien - Chapter 2 
Kerlinger - Chapters 1, 2, \ 3 

Gerlach et al - "Defining Instructional Specifications" 

'^Describing Educational Outcomes” 
"Constructing Statements of Outcomes" 

Part III Instruments for Measurement 

Menthl Measurements Yearbook - Pages 1-1379 

Kerlinger - Chapters 26* 2^i 28, 29^ 30, 31, 32, & 33 

Webb et al • Entire Book 

ETS - Test Construction Kit 

Lien - Chapters 4* 5, & 6 

Downie - Chapters 6-18 

Payne & McMorris - Chapters 5 & 6 

Conrad - Sociology of Education . Spring 1967 

Part IV Preparing for the Research Project 

Gage - Chapter 1 

Kerlinger - Chapters 15, 16, 17, 18, & 19 
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